-- Logs begin at Fri 2022-10-21 14:13:55 UTC, end at Fri 2022-10-21 15:25:38 UTC. -- Oct 21 14:55:23.669420 dv-cinder-836083-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 21 14:55:23.678560 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 21 14:55:23 2022] *** Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: nodename: dv-cinder-836083-16-iscsi Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: machine: x86_64 Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: clock source: unix Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: pcre jit disabled Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: detected number of CPU cores: 4 Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: current working directory: / Oct 21 14:55:23.680580 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: detected binary path: /usr/bin/uwsgi-core Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: your processes number limit is 47680 Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: your memory page size is 4096 bytes Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: detected max file descriptor number: 2048 Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: lock engine: pthread robust mutexes Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: thunder lock: enabled Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 21 14:55:23.681304 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 21 14:55:23.721517 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: Python main interpreter initialized at 0x55c7674ab9c0 Oct 21 14:55:23.721517 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: python threads support enabled Oct 21 14:55:23.721517 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: your server socket listen backlog is limited to 100 connections Oct 21 14:55:23.721517 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: your mercy for graceful operations on workers is 90 seconds Oct 21 14:55:23.721827 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: mapped 403077 bytes (393 KB) for 2 cores Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: *** Operational MODE: preforking *** Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: *** uWSGI is running in multiple interpreter mode *** Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: spawned uWSGI master process (pid: 104310) Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: spawned uWSGI worker 1 (pid: 104311, cores: 1) Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: spawned uWSGI worker 2 (pid: 104312, cores: 1) Oct 21 14:55:23.727525 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 21 14:55:23.722356 dv-cinder-836083-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 21 14:55:24.379908 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 21 14:55:24.389118 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 21 14:55:25.470336 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 14:55:25.470336 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: from cryptography.utils import int_from_bytes Oct 21 14:55:25.471067 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 14:55:25.471067 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: from cryptography.utils import int_from_bytes Oct 21 14:55:25.472823 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 14:55:25.472823 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: from cryptography.utils import int_from_bytes Oct 21 14:55:25.473258 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 14:55:25.473258 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: from cryptography.utils import int_from_bytes Oct 21 14:55:27.948814 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 14:55:27.949437 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 14:55:27.949804 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 14:55:27.949894 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 14:55:27.949981 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 14:55:27.950055 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 14:55:27.950128 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 14:55:27.950203 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 14:55:27.950276 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 14:55:27.950354 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 14:55:27.950771 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.950880 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.950967 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.951041 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.951234 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.951332 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952069 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952173 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952472 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952577 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952867 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.952965 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953186 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953285 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953503 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953612 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953827 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.953936 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954085 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954193 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954396 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954489 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954736 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-16-iscsi {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.954838 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-16-iscsi {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955056 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955149 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955359 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955445 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955665 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955751 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.955979 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956071 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956277 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956376 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956592 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956679 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956895 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.956986 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.957384 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.957778 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.957961 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958111 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958257 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958404 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958404 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958778 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.958915 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959007 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959146 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959241 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959328 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959416 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959638 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959724 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.959943 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960035 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960262 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960346 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960567 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960666 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.960957 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-16-iscsi {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961055 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-16-iscsi {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961268 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961362 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961575 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961708 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961881 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.961977 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.962283 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.962441 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.962585 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.962728 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.962913 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963229 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963321 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963546 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963684 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963848 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.963944 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964166 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964253 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964480 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964647 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964794 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.964935 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965109 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965203 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965406 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965501 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965708 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.965794 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966012 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966111 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966323 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966410 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966620 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966754 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.966937 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.967033 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.967766 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.967917 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968057 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968219 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968373 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968547 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968689 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.968869 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969006 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969193 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969287 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969446 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969534 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969698 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.969795 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970020 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970114 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970340 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970428 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970671 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970824 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.970972 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971076 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971273 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971366 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971574 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971677 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971874 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.971974 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972174 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972267 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972478 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972634 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972789 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.972940 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973073 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973208 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973382 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973518 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973682 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973829 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.973996 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974131 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974312 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974457 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974606 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974796 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.974946 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975085 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975255 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975400 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975571 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975724 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.975864 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976007 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976173 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976317 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976491 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976725 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.976886 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977031 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977169 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977314 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977453 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977590 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977726 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.977869 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978015 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978164 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978303 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978446 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978599 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.978798 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979473 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979561 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979648 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979729 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979808 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979892 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.979980 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980060 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980148 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980235 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980321 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980400 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980531 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980620 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980833 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.980926 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981132 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981237 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981433 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981571 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981733 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.981819 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982033 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982135 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982332 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982440 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982662 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982759 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.982984 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983085 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983337 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983427 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983582 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983668 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983883 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.983978 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984201 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984295 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984518 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984605 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984824 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.984919 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985125 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985226 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985425 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985522 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985728 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.985824 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986025 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986110 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986325 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986411 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986625 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986747 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.986960 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987044 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987259 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987346 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987560 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987657 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987862 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.987947 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988163 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988257 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988465 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988557 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988757 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.988842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989062 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989168 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989364 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989450 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989662 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989747 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.989966 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990051 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990261 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990347 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990559 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990741 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990884 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.990970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991186 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991275 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991488 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991627 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991788 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.991880 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992090 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992175 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992386 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992470 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992703 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.992840 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993005 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993112 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993308 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993413 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993607 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993712 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.993907 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.994002 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.994222 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 14:55:27.994324 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.994549 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.994743 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.994900 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.994994 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995291 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995533 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995622 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995859 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.995951 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996171 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996264 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996478 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996570 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996786 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.996877 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997097 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997188 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997399 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997491 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997705 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.997792 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998010 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998108 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998319 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998456 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998719 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.998819 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999033 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999155 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999320 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999431 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999633 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999732 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:27.999944 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000037 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000251 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000337 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000563 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000655 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000883 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.000982 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001196 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001281 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001503 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001597 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001815 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.001919 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002156 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002250 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002466 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002552 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002811 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.002923 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003130 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003217 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003440 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003532 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003748 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.003846 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004056 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004140 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004366 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004452 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004696 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.004788 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005007 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005100 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005317 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005401 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005627 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005728 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.005943 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006028 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006250 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006341 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006559 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006668 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006894 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.006979 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007203 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007298 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007513 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007600 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007821 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.007905 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008140 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008237 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008455 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008539 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008764 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.008856 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009075 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009169 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009475 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009699 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.009814 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010010 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010167 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010310 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010445 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010601 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010731 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.010925 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011028 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011227 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011314 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011530 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011622 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011829 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.011931 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012133 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012219 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012455 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012541 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012756 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.012860 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013078 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013167 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013379 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013466 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013687 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.013784 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.014512 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.014614 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.014859 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015067 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015283 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015372 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015598 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015692 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.015920 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016007 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016235 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016322 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016544 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016630 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016873 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.016998 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017176 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017264 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017480 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017564 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017791 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.017885 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018096 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018182 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018401 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018485 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018731 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.018839 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019042 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019136 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019373 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019471 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019656 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019771 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.019966 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020054 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020282 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020366 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020592 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020690 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020902 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.020986 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021239 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021326 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021539 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021624 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021860 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.021944 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022179 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022263 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022491 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022578 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022817 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.022905 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023134 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023285 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023421 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023507 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023722 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.023807 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024022 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024114 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024326 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024409 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024626 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024712 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.024926 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025023 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025225 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025317 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025525 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025617 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025824 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.025922 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026126 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026217 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026435 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026523 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026759 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.026866 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027062 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027157 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027364 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027448 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027667 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027753 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.027990 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028082 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028303 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028388 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028646 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028732 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.028960 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.029052 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.029278 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.029365 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.029605 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.030280 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.030464 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.030586 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.030796 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.030952 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.031108 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.031268 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.031418 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.031582 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.031988 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032162 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032308 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032488 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032616 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032792 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.032937 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033104 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033247 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033429 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033569 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033743 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.033879 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034070 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034196 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034384 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034500 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034727 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.034818 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035036 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035161 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035356 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035492 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035699 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.035808 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036037 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036124 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036358 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036451 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036680 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036777 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.036993 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037078 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037311 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037396 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037619 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037713 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.037928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038014 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038236 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038320 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038542 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038653 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038889 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.038983 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039197 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039282 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039513 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039740 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039830 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.039904 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040122 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040207 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040429 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040516 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040740 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.040837 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041042 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041126 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041357 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041442 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041676 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041762 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.041987 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042079 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042305 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042389 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042608 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042713 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.042942 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043028 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043250 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043337 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043552 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043640 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.043855 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044021 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044160 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044245 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044467 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044552 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044772 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.044865 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045080 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045173 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045427 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045521 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045739 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.045884 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046046 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046202 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046348 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046520 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046678 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046862 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.046989 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047167 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047308 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047473 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047616 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047786 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.047935 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048108 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048254 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048419 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048557 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048742 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.048857 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049067 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049176 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049372 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049472 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049677 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049825 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.049999 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050092 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050308 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050403 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050675 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050766 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.050941 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051028 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051248 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051348 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051588 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051679 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051896 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.051980 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052203 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052295 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052513 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052599 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052822 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.052908 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053131 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053218 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053446 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053566 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053754 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.053839 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054062 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054149 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054370 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054456 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054698 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.054800 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055010 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055095 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055316 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055401 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055625 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055718 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.055930 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056014 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056239 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056323 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056548 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056641 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056851 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.056936 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.057158 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.057242 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.057473 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.057567 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.057778 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058037 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058123 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058369 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058454 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058700 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.058972 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059060 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059306 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059391 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059621 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059716 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.059940 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060029 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060278 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060362 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060590 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060722 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.060919 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061020 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061230 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061503 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061595 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061823 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.061907 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062130 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062217 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062432 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062517 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062755 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.062862 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063059 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063145 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063365 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063450 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063667 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063761 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.063969 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064055 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064269 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064354 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064570 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064663 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064873 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.064964 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065170 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065261 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065474 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065567 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065777 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.065874 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066091 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066176 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066395 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066480 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066719 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.066807 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067023 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067107 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067322 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067408 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067639 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067723 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.067949 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068044 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068255 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068344 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068562 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068647 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068908 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.068994 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069207 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069292 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069509 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069594 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069828 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.069969 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070136 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070223 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070434 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070519 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070761 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.070864 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071068 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071154 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071371 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071456 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071667 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071760 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.071974 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072066 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072279 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072364 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072585 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072677 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072886 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.072970 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073184 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073270 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073486 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073572 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073783 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.073868 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074089 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074172 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074398 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074542 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074708 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.074806 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075007 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075100 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075312 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075399 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075617 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075712 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.075912 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.076005 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.076215 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.076302 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077034 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077140 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077344 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077441 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077644 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077771 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.077944 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078029 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078240 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078343 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078545 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078667 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078875 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.078961 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079173 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079269 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079477 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079564 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079785 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.079869 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080084 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080178 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080384 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080470 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080691 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080776 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.080993 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081099 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081290 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081376 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081593 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081680 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081902 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.081988 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082209 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082295 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082506 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082607 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082832 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.082922 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083136 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083223 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083437 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083522 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083735 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.083821 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084040 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084133 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084337 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084436 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084637 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084731 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.084936 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085022 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085236 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085331 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085538 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085623 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085844 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.085936 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086145 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086239 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086447 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086533 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086768 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.086859 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087067 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087170 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087389 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087473 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087693 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087776 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.087997 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088082 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088304 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088389 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088630 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088714 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.088940 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089032 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089245 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089555 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089641 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089868 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.089954 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090169 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090255 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090486 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090572 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090818 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.090906 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091129 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091216 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091429 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091528 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091727 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.091813 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.092044 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.092193 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.092897 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093001 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093208 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093307 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093511 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093598 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093826 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.093920 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094138 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094223 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094436 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094528 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094767 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.094875 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095074 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095168 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095378 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095464 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095683 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095770 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.095987 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096073 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096292 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096379 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096599 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096692 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096903 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.096988 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097209 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097307 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097513 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097601 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097812 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.097897 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098114 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098200 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098417 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098504 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098741 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.098841 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099046 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099139 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099352 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099457 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099651 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099748 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.099950 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100044 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100247 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100378 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100558 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100645 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100856 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.100954 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101161 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101273 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101467 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101579 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101777 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.101876 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102081 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102175 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102462 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102547 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102790 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.102892 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103101 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103194 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103408 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103500 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103707 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.103794 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104015 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104099 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104329 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104414 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104642 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104729 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.104945 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105039 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105274 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105359 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105572 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105659 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105876 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.105961 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106193 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106286 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106490 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106576 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106810 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.106910 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107111 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107205 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107427 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107513 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107748 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.107843 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108055 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108279 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108366 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108666 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108749 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.108971 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.109065 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.109290 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.109375 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.109701 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.109793 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110007 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110099 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110309 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110393 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110665 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110761 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.110967 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111065 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111286 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111382 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111590 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111676 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111900 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.111986 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112205 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112299 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112522 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112841 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.112935 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113148 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113241 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113453 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113541 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113753 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.113847 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114071 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114381 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114473 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114707 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.114796 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115126 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115343 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115435 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115656 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115741 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.115976 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116062 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116335 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116429 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116657 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116752 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.116959 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117046 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117259 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117352 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117564 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117650 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117866 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.117952 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118167 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118261 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118487 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118595 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118816 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.118903 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119126 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119213 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119552 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119756 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.119848 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120056 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120150 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120362 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120498 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120670 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120758 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.120965 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121049 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121267 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121405 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121574 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121661 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121879 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.121964 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122193 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122278 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122493 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122580 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122833 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.122921 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123136 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123225 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123471 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123567 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123791 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.123998 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124099 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124305 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124391 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124644 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124731 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.124947 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125043 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125262 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125349 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125587 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125673 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.125907 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126001 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126211 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126303 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126539 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126678 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126877 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.126964 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127191 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127276 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127584 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127808 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.127896 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128120 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128204 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128416 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128547 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128713 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.128801 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129103 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129314 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129409 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129613 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129700 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129910 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.129996 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130210 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130303 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130510 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130595 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130831 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.130919 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131131 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131229 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131436 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131520 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131731 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.131816 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132047 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132142 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132347 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132432 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132642 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132727 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.132941 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133030 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133240 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133342 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133543 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133629 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133845 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.133970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134166 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134284 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134463 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134553 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134802 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.134892 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135114 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135198 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135423 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135507 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135731 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.135819 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136039 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136126 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136349 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136480 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136656 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136744 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.136963 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137049 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137264 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137359 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137573 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137659 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137881 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.137965 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.138190 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.138289 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.138503 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.138730 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.138838 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.139588 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.139878 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140119 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140217 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140297 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140486 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140581 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140796 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.140943 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141104 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141191 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141408 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141495 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141714 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.141809 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142018 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142105 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142325 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142412 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142659 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142749 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.142969 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143056 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143288 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143383 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143609 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143694 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.143916 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144001 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144227 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144394 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144538 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144624 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144846 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.144934 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145158 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145252 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145473 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145561 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145780 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.145873 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146091 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146178 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146403 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146489 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146733 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.146836 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147041 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147135 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147346 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147433 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147655 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147752 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.147963 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148050 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148268 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148354 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148572 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148669 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148881 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.148975 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149184 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149270 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149495 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149589 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149810 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.149895 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150122 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150213 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150435 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150522 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150765 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.150855 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151078 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151175 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151390 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151703 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151806 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.151887 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152300 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152515 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152601 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152832 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.152926 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153143 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153242 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153456 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153543 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153770 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.153855 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.154069 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.154166 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.154369 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.154462 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.155307 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.155473 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.155642 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.155738 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.155948 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.156037 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.156270 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.156357 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.156582 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.156927 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157136 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157221 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157452 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157542 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157757 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.157845 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.158080 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.158283 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.158391 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.158644 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.158954 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159042 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159273 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159358 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159595 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159908 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.159996 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160213 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160299 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160531 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160623 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160830 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.160915 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161133 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161229 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161443 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161543 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161818 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.161916 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162047 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162132 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162345 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162441 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162671 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162778 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.162980 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163065 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163277 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163367 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163581 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163667 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163880 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.163966 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164187 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164284 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164488 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164573 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164788 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.164874 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165087 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165174 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165393 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165487 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165692 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165778 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.165989 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166083 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166288 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166373 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166586 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166698 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.166916 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167002 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167211 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167296 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167516 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167603 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167815 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.167901 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168116 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168203 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168417 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168510 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168727 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.168820 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169034 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169137 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169348 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169445 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169647 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169734 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.169943 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170029 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170277 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170384 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170585 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170724 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.170925 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171010 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171238 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171337 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171561 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171647 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.171879 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172014 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172191 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172294 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172536 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172741 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.172839 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.173072 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.173368 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.173490 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.173701 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.173804 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174019 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174114 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174318 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174413 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174616 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174756 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.174937 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175032 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175258 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175348 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175563 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175649 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175869 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.175964 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176175 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176263 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176480 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176568 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176784 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.176880 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177088 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177182 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177392 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177479 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177696 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177791 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.177998 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178085 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178301 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178387 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178603 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178769 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.178926 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179028 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179231 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179332 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179534 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179622 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179840 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.179926 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180148 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180234 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180464 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180553 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180779 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.180874 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181092 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181270 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181402 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181491 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181709 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.181809 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182014 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182124 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182317 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182403 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182620 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182741 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.182950 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183053 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183260 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183354 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183568 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183654 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183868 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.183957 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.184195 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.184503 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.184588 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.184823 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185139 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185235 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185457 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185545 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185762 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.185849 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.186121 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.186313 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.186441 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.186684 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.186863 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187017 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187184 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187343 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187492 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187660 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187816 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.187986 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188150 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188298 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188474 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188629 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188794 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.188968 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189096 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189303 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189419 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189632 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189741 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.189939 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190055 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190248 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190387 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190551 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190724 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.190880 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191010 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191163 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191302 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191472 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191614 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191772 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.191911 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192146 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192290 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192427 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192570 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192706 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192840 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.192975 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193120 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193267 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193401 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193563 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193694 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193830 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.193962 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194105 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194238 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194371 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194505 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194658 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194802 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.194956 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195106 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195247 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195381 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195515 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195647 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195825 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.195957 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196099 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196245 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196399 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196547 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196727 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.196863 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197056 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197191 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197356 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197499 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197671 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197816 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.197978 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198113 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198292 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198440 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198580 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198706 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.198970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199065 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199242 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199338 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199574 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199672 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199851 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.199950 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200175 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200263 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200482 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200568 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200788 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.200882 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.201097 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.201186 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.201403 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202026 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202289 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202387 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202606 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202814 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.202944 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203197 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203284 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203559 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203671 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203884 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.203969 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.204208 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.204302 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.204525 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.204611 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.204843 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205072 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205158 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205404 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205499 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205728 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.205814 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206049 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206136 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206354 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206448 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206678 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206771 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.206989 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207075 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207295 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207384 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207605 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207691 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.207910 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208006 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208217 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208305 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208528 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208614 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208840 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.208924 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209156 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209251 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209475 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209606 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209778 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.209874 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210098 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210191 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210419 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210506 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210753 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.210920 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211081 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211176 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211409 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211495 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211731 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.211829 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212041 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212128 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212351 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212452 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212649 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212738 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.212889 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 14:55:28.213005 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.213320 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.213628 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 14:55:28.213874 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 14:55:28.365702 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO dbcounter [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Registered counter for database nova_api Oct 21 14:55:28.366175 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO dbcounter [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Registered counter for database nova_api Oct 21 14:55:28.386964 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_db.sqlalchemy.engines [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.388527 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.394229 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writer thread running {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.395581 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writer thread running {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.450156 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.context [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc1fe804-a1c0-4f42-88c1-97d74249e7fa(cell1) {{(pid=104311) load_cells /opt/stack/nova/nova/context.py:464}} Oct 21 14:55:28.450975 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.context [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc1fe804-a1c0-4f42-88c1-97d74249e7fa(cell1) {{(pid=104312) load_cells /opt/stack/nova/nova/context.py:464}} Oct 21 14:55:28.454503 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 14:55:28.455003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 14:55:28.455846 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 14:55:28.456316 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 14:55:28.456602 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 14:55:28.457315 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 14:55:28.457760 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 14:55:28.457905 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 14:55:28.458620 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 14:55:28.459101 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 14:55:28.459765 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 14:55:28.461090 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_concurrency.lockutils [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 14:55:28.461733 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO dbcounter [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Registered counter for database nova_cell0 Oct 21 14:55:28.463103 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO dbcounter [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Registered counter for database nova_cell0 Oct 21 14:55:28.465808 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO dbcounter [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Registered counter for database nova_cell1 Oct 21 14:55:28.467176 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO dbcounter [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Registered counter for database nova_cell1 Oct 21 14:55:28.473151 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_db.sqlalchemy.engines [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.475323 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_db.sqlalchemy.engines [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.476969 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.478786 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.480428 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writer thread running {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.483285 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writer thread running {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.483885 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writer thread running {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.618229 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writer thread running {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.625903 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO dbcounter [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Registered counter for database nova_cell0 Oct 21 14:55:28.628819 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO dbcounter [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Registered counter for database nova_cell0 Oct 21 14:55:28.632855 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_db.sqlalchemy.engines [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.637539 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG oslo_db.sqlalchemy.engines [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 14:55:28.637684 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writer thread running {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:28.642968 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writer thread running {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 14:55:29.073262 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: WARNING keystonemiddleware.auth_token [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 14:55:29.081568 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: WARNING keystonemiddleware.auth_token [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 14:55:29.091352 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: WARNING keystonemiddleware.auth_token [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 14:55:29.098830 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: WARNING keystonemiddleware.auth_token [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 14:55:29.433559 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: WARNING keystonemiddleware.auth_token [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 14:55:29.440614 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: WARNING keystonemiddleware.auth_token [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 14:55:29.443271 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: WARNING keystonemiddleware.auth_token [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 14:55:29.445862 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7674ab9c0 pid: 104311 (default app) Oct 21 14:55:29.447947 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:55:29.449129 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Oct 21 14:55:29.449227 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: WARNING keystonemiddleware.auth_token [None req-2fe498d4-ed20-43e5-8d83-f1a48ee46bf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 14:55:29.449546 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Fri Oct 21 14:55:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:55:29.454514 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7674ab9c0 pid: 104312 (default app) Oct 21 14:56:54.462126 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:56:54.468070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 21 14:56:54.468070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:56:54.480493 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_api:SELECT=3 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:54.482246 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_cell0:SELECT=3 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:54.483301 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_cell1:SELECT=3 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:54.484297 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:55.379286 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-3d338b75-55d4-4230-a465-19904d853bda admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:56:55.413383 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-3d338b75-55d4-4230-a465-19904d853bda admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.942293 Oct 21 14:56:55.414255 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Oct 21 14:56:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 14:56:58.048262 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:56:58.049275 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-3df5f3ac-a54d-460e-aca5-ebf80d618616 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 21 14:56:58.049844 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:56:58.507063 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-4003f165-9ffd-4f42-a5c9-04c3cd5f9558 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:56:58.622405 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-4003f165-9ffd-4f42-a5c9-04c3cd5f9558 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.566082 Oct 21 14:56:58.623228 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:56:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:56:58.841664 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-959ae5c2-1205-4df2-8090-6d606987a5c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:56:58.848295 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_api:SELECT=3 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:58.849386 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_cell0:SELECT=3 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:58.850140 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_cell1:SELECT=3 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:58.850916 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:56:58.962987 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-959ae5c2-1205-4df2-8090-6d606987a5c7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330963 Oct 21 14:56:58.963607 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Oct 21 14:56:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:01.571345 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-4003f165-9ffd-4f42-a5c9-04c3cd5f9558 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:01.572508 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-4003f165-9ffd-4f42-a5c9-04c3cd5f9558 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Oct 21 14:57:01.573045 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:02.230331 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-c0179777-741c-4863-a288-e8c79cef80e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "id": "d1"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:02.363307 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-c0179777-741c-4863-a288-e8c79cef80e4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.783630 Oct 21 14:57:02.363943 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:02.376671 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-1c230a7e-c50a-4ccb-86bb-5473b02a0254 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:02.514091 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-1c230a7e-c50a-4ccb-86bb-5473b02a0254 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141615 Oct 21 14:57:02.522886 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Oct 21 14:57:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 14:57:05.108125 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-c0179777-741c-4863-a288-e8c79cef80e4 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:05.109160 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-c0179777-741c-4863-a288-e8c79cef80e4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 21 14:57:05.109567 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 14:57:05.528894 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-1c8ec428-5447-4244-a601-595e795b120b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:05.606199 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-1c8ec428-5447-4244-a601-595e795b120b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490372 Oct 21 14:57:05.607064 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:05.619049 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-514fd158-8afd-4269-84d4-f4be503abe15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:05.708239 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-514fd158-8afd-4269-84d4-f4be503abe15 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092872 Oct 21 14:57:05.708944 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Oct 21 14:57:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:08.334409 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-1c8ec428-5447-4244-a601-595e795b120b admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:08.335393 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-1c8ec428-5447-4244-a601-595e795b120b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 21 14:57:08.335797 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:08.761667 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-29948841-b3b2-4baf-94c9-f3c15aab2c68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "ram": 2048, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:08.846729 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-29948841-b3b2-4baf-94c9-f3c15aab2c68 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503856 Oct 21 14:57:08.847440 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 21 14:57:08.859949 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-edd62c09-9336-49e9-9d0f-1c4998ccc1d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:08.963465 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-edd62c09-9336-49e9-9d0f-1c4998ccc1d8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107387 Oct 21 14:57:08.964083 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Oct 21 14:57:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 14:57:11.580994 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-29948841-b3b2-4baf-94c9-f3c15aab2c68 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:11.581933 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-29948841-b3b2-4baf-94c9-f3c15aab2c68 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 21 14:57:11.582333 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:12.022173 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "swap": 0, "disk": 20}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:12.103694 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513295 Oct 21 14:57:12.104186 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:12.116908 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-9ab2b474-0e7d-495b-b61d-adc1fac215ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:12.211890 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-9ab2b474-0e7d-495b-b61d-adc1fac215ba admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098403 Oct 21 14:57:12.212658 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Oct 21 14:57:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:15.152792 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:15.153918 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Oct 21 14:57:15.154296 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:15.563534 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7d832dcf-13eb-48f3-b0e6-f86a9baaf516 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:15.588644 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7d832dcf-13eb-48f3-b0e6-f86a9baaf516 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.427385 Oct 21 14:57:15.589128 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Oct 21 14:57:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:18.177647 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:18.178687 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-a6f87696-f32a-4dc9-b72a-cc2a0e24a08c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 21 14:57:18.179101 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:18.578783 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7b0c309d-7580-4c73-a33e-6f5e50806a25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:18.653048 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7b0c309d-7580-4c73-a33e-6f5e50806a25 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467563 Oct 21 14:57:18.654672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:18.667427 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-ce442e42-77f2-4439-af47-5abd7b245765 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:18.770956 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-ce442e42-77f2-4439-af47-5abd7b245765 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107170 Oct 21 14:57:18.771514 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Oct 21 14:57:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:21.401324 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7b0c309d-7580-4c73-a33e-6f5e50806a25 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:21.402261 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7b0c309d-7580-4c73-a33e-6f5e50806a25 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 21 14:57:21.402684 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:21.781662 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-24f9a2dc-0374-4e30-90a3-a98dab55733f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:21.857209 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-24f9a2dc-0374-4e30-90a3-a98dab55733f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447382 Oct 21 14:57:21.857770 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:21.869944 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-ef73b73a-ae34-4120-af6e-f4ce7c6c4b47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:21.946959 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-ef73b73a-ae34-4120-af6e-f4ce7c6c4b47 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080520 Oct 21 14:57:21.948017 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Oct 21 14:57:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:24.626275 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-24f9a2dc-0374-4e30-90a3-a98dab55733f admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:24.627244 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-24f9a2dc-0374-4e30-90a3-a98dab55733f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Oct 21 14:57:24.627651 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:25.085969 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-2ab55833-9306-4741-8dfe-8cdf4f8d6ab3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:25.161892 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-2ab55833-9306-4741-8dfe-8cdf4f8d6ab3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.527924 Oct 21 14:57:25.162827 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:25.176244 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-fd88e5d3-b6b7-4761-9b1c-21fc5d0977bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:25.181419 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:57:25.255714 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-fd88e5d3-b6b7-4761-9b1c-21fc5d0977bb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084832 Oct 21 14:57:25.256236 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Oct 21 14:57:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:27.946231 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-2ab55833-9306-4741-8dfe-8cdf4f8d6ab3 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:27.947211 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-2ab55833-9306-4741-8dfe-8cdf4f8d6ab3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 21 14:57:27.953852 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:28.461930 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-4a9b20eb-1e81-43eb-bbd3-a4177b1dd18f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:28.560696 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-4a9b20eb-1e81-43eb-bbd3-a4177b1dd18f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.605173 Oct 21 14:57:28.562132 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:28.574910 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-77cb97e8-44f1-44d6-8802-9f1b97e5eee6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:28.709088 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-77cb97e8-44f1-44d6-8802-9f1b97e5eee6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137980 Oct 21 14:57:28.709718 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Oct 21 14:57:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 14:57:31.355296 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-4a9b20eb-1e81-43eb-bbd3-a4177b1dd18f admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:31.356487 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-4a9b20eb-1e81-43eb-bbd3-a4177b1dd18f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Oct 21 14:57:31.357058 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:31.795367 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "ram": 16384, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:31.802778 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:57:31.874404 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.510521 Oct 21 14:57:31.875381 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Oct 21 14:57:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:31.887679 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-d8662c88-26ae-4482-b8fe-cf41759b106a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:31.992882 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-d8662c88-26ae-4482-b8fe-cf41759b106a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109164 Oct 21 14:57:31.996403 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Oct 21 14:57:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:57:49.103147 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:49.104224 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Oct 21 14:57:49.104626 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:49.116059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:57:49.497868 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-0866be94-7d46-42fe-8cb8-ba7cfdc33396 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:49.517357 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-0866be94-7d46-42fe-8cb8-ba7cfdc33396 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405553 Oct 21 14:57:49.517830 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Oct 21 14:57:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:50.821753 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:50.822802 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-7ef5c811-06a4-45c9-b7d2-25f77319082f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 21 14:57:50.823205 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 14:57:51.360490 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-8144e9de-b4f4-4c06-9f4d-a14b5d21cbf7 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:51.366123 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.wsgi [None req-8144e9de-b4f4-4c06-9f4d-a14b5d21cbf7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-8144e9de-b4f4-4c06-9f4d-a14b5d21cbf7 admin admin] Request method failure captured: Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept: application/json Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept-Encoding: gzip, deflate Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Connection: keep-alive Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Content-Length: 0 Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Host: 10.222.0.60 Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-System-Scope: None Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: User-Agent: python-novaclient Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Auth-Token: gAAAAABjUrNu6nSHYrNVduEvxv79UoiRJmvTyEbB-0SnMuUdRmLp3CN6hNhRs54b-3ZnoSNsB9UjvMmX4H8b8MLMlnz6n-luV82_oZLOOk7JnOPYW0_Mzg5jgYb9_aRW9Es4un0MyiJa-Env5haUxD_dM-ZSYU6GZbAQMO1KA2ZKEdGN3mkFmBU Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Id: None Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Name: None Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Identity-Status: Confirmed Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Is-Admin-Project: True Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Id: default Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Name: Default Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Name: admin Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Role: admin,reader,member Oct 21 14:57:51.369453 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Roles: admin,reader,member Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant: admin Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Name: admin Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User: admin Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Id: default Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Name: Default Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Name: admin Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: method: > Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: exception: Flavor 42 could not be found. Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: action_args: {'id': '42'} Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:51.370842 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:51.372171 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.373681 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-8144e9de-b4f4-4c06-9f4d-a14b5d21cbf7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:51.375805 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-8144e9de-b4f4-4c06-9f4d-a14b5d21cbf7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.404862 Oct 21 14:57:51.375805 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Oct 21 14:57:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 21 14:57:51.381830 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-c2736d02-61c2-4023-a525-fbd041a4927b admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:51.405059 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-c2736d02-61c2-4023-a525-fbd041a4927b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027237 Oct 21 14:57:51.411080 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 14:57:51.417102 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-257fa606-1f93-4020-b8bb-8c9930f3165a admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:51.441046 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-257fa606-1f93-4020-b8bb-8c9930f3165a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028646 Oct 21 14:57:51.441632 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 14:57:51.451723 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-d2b2a281-ae91-4fa1-86a3-0ee3d2b77811 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:51.458662 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.wsgi [None req-d2b2a281-ae91-4fa1-86a3-0ee3d2b77811 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-d2b2a281-ae91-4fa1-86a3-0ee3d2b77811 admin admin] Request method failure captured: Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept: application/json Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept-Encoding: gzip, deflate Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Connection: keep-alive Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Content-Length: 0 Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Host: 10.222.0.60 Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-System-Scope: None Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: User-Agent: python-novaclient Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Auth-Token: gAAAAABjUrNu6nSHYrNVduEvxv79UoiRJmvTyEbB-0SnMuUdRmLp3CN6hNhRs54b-3ZnoSNsB9UjvMmX4H8b8MLMlnz6n-luV82_oZLOOk7JnOPYW0_Mzg5jgYb9_aRW9Es4un0MyiJa-Env5haUxD_dM-ZSYU6GZbAQMO1KA2ZKEdGN3mkFmBU Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Id: None Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Name: None Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Identity-Status: Confirmed Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Is-Admin-Project: True Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Id: default Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Name: Default Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Name: admin Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Role: admin,reader,member Oct 21 14:57:51.461928 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Roles: admin,reader,member Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant: admin Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Name: admin Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User: admin Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Id: default Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Name: Default Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Name: admin Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: method: > Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: exception: Flavor 42 could not be found. Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: action_args: {'id': '42'} Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:51.463206 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:51.464016 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:51.465024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-d2b2a281-ae91-4fa1-86a3-0ee3d2b77811 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:51.466044 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-d2b2a281-ae91-4fa1-86a3-0ee3d2b77811 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015399 Oct 21 14:57:51.466044 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Oct 21 14:57:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 21 14:57:52.693892 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-257fa606-1f93-4020-b8bb-8c9930f3165a admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:52.694974 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-257fa606-1f93-4020-b8bb-8c9930f3165a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 21 14:57:52.695404 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:53.220449 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-cd18d4e0-eef7-482f-bd7b-6fb8fb321536 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:53.225488 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.wsgi [None req-cd18d4e0-eef7-482f-bd7b-6fb8fb321536 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-cd18d4e0-eef7-482f-bd7b-6fb8fb321536 admin admin] Request method failure captured: Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept: application/json Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept-Encoding: gzip, deflate Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Connection: keep-alive Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Content-Length: 0 Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Host: 10.222.0.60 Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-System-Scope: None Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: User-Agent: python-novaclient Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Auth-Token: gAAAAABjUrNw0ZaKjJCxdsLL43oXGja0G4-SNKCEQG3Eaz7wK-gKN0-ED15OLWt6z-z9dsmTTNhQG9ODY_iafqqCWgDHzf2VDYycgY1Z3QauROK3-q8aTS4ibEL8-MkDfeWfH7vGiXo5ohXsKelN42f3KnrzjgcxF6v6oi2LvlSkj41wwVG3dTs Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Id: None Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Name: None Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Identity-Status: Confirmed Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Is-Admin-Project: True Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Id: default Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Name: Default Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Name: admin Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Role: admin,reader,member Oct 21 14:57:53.227003 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Roles: admin,reader,member Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant: admin Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Name: admin Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User: admin Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Id: default Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Name: Default Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Name: admin Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: method: > Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: exception: Flavor 84 could not be found. Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: action_args: {'id': '84'} Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:53.228496 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:53.229383 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.230970 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-cd18d4e0-eef7-482f-bd7b-6fb8fb321536 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:53.232204 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-cd18d4e0-eef7-482f-bd7b-6fb8fb321536 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391888 Oct 21 14:57:53.232204 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Oct 21 14:57:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 21 14:57:53.238649 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-69e04748-6d2b-4638-bbc6-275ab6b4558c admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:53.254577 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-69e04748-6d2b-4638-bbc6-275ab6b4558c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019429 Oct 21 14:57:53.255144 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:53.264509 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-e6ff1db6-dd32-4021-a9da-ee316ea23f68 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:53.280098 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-e6ff1db6-dd32-4021-a9da-ee316ea23f68 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019041 Oct 21 14:57:53.280773 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:53.290035 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-06cd4567-346f-4778-8d21-37a8609a14ec admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:53.295211 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.wsgi [None req-06cd4567-346f-4778-8d21-37a8609a14ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-06cd4567-346f-4778-8d21-37a8609a14ec admin admin] Request method failure captured: Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept: application/json Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept-Encoding: gzip, deflate Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Connection: keep-alive Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Content-Length: 0 Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Host: 10.222.0.60 Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-System-Scope: None Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: User-Agent: python-novaclient Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Auth-Token: gAAAAABjUrNw0ZaKjJCxdsLL43oXGja0G4-SNKCEQG3Eaz7wK-gKN0-ED15OLWt6z-z9dsmTTNhQG9ODY_iafqqCWgDHzf2VDYycgY1Z3QauROK3-q8aTS4ibEL8-MkDfeWfH7vGiXo5ohXsKelN42f3KnrzjgcxF6v6oi2LvlSkj41wwVG3dTs Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Id: None Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Name: None Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Identity-Status: Confirmed Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Is-Admin-Project: True Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Id: default Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Name: Default Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Name: admin Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Role: admin,reader,member Oct 21 14:57:53.297330 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Roles: admin,reader,member Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant: admin Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Name: admin Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User: admin Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Id: default Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Name: Default Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Name: admin Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: method: > Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: exception: Flavor 84 could not be found. Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: action_args: {'id': '84'} Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:53.298978 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:53.300059 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:53.301388 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-06cd4567-346f-4778-8d21-37a8609a14ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:53.302673 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-06cd4567-346f-4778-8d21-37a8609a14ec admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012108 Oct 21 14:57:53.302673 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Oct 21 14:57:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 21 14:57:54.521850 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-e6ff1db6-dd32-4021-a9da-ee316ea23f68 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:54.522892 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-e6ff1db6-dd32-4021-a9da-ee316ea23f68 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 21 14:57:54.523287 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:55.044904 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b5015dfb-89e5-4300-b7d6-27b12a02504b admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:55.051554 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.wsgi [None req-b5015dfb-89e5-4300-b7d6-27b12a02504b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b5015dfb-89e5-4300-b7d6-27b12a02504b admin admin] Request method failure captured: Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept: application/json Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Accept-Encoding: gzip, deflate Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Connection: keep-alive Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Content-Length: 0 Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Host: 10.222.0.60 Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Openstack-System-Scope: None Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: User-Agent: python-novaclient Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Auth-Token: gAAAAABjUrNyHdKO-7OmmQA7NIXHLdy8DkHLYwMT6m1ScV9QddoWN2-X2A283dmMsDg2I7gtiH5gfQ8OubHCkM_MfKts5kYziC4zr7OqqaNyLuaA-IPsX1sNPdyoBQrpXE6Q6cwNzyNwKDVru-bmjeWeyTCwJ8UbC5Guu7MuBMaVopXR4ASVYvU Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Id: None Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Domain-Name: None Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Identity-Status: Confirmed Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Is-Admin-Project: True Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Id: default Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Domain-Name: Default Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Project-Name: admin Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Role: admin,reader,member Oct 21 14:57:55.053069 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Roles: admin,reader,member Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant: admin Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-Tenant-Name: admin Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User: admin Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Id: default Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Domain-Name: Default Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: X-User-Name: admin Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: method: > Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: exception: Flavor 451 could not be found. Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: action_args: {'id': '451'} Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:55.054615 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:55.055613 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.057004 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b5015dfb-89e5-4300-b7d6-27b12a02504b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:55.058196 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b5015dfb-89e5-4300-b7d6-27b12a02504b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394690 Oct 21 14:57:55.058196 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 14:57:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 21 14:57:55.064548 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-422b58b7-c30e-405a-a2c6-635041206b0b admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:55.079501 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-422b58b7-c30e-405a-a2c6-635041206b0b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018710 Oct 21 14:57:55.080140 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:55.089376 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:55.104889 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019035 Oct 21 14:57:55.105436 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Oct 21 14:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:57:55.118545 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-4996f791-0384-4da2-85eb-04203f24cf93 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:55.123682 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.wsgi [None req-4996f791-0384-4da2-85eb-04203f24cf93 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-4996f791-0384-4da2-85eb-04203f24cf93 admin admin] Request method failure captured: Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept: application/json Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Accept-Encoding: gzip, deflate Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Connection: keep-alive Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Content-Length: 0 Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Host: 10.222.0.60 Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-Api-Version: compute 2.92 Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Openstack-System-Scope: None Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: User-Agent: python-novaclient Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Auth-Token: gAAAAABjUrNyHdKO-7OmmQA7NIXHLdy8DkHLYwMT6m1ScV9QddoWN2-X2A283dmMsDg2I7gtiH5gfQ8OubHCkM_MfKts5kYziC4zr7OqqaNyLuaA-IPsX1sNPdyoBQrpXE6Q6cwNzyNwKDVru-bmjeWeyTCwJ8UbC5Guu7MuBMaVopXR4ASVYvU Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Id: None Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Domain-Name: None Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Identity-Status: Confirmed Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Is-Admin-Project: True Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Openstack-Nova-Api-Version: 2.92 Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Id: default Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Domain-Name: Default Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Project-Name: admin Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Role: admin,reader,member Oct 21 14:57:55.125530 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Roles: admin,reader,member Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd93ea5b05642848d07178b50fbac9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd93ea5b05642848d07178b50fbac9f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant: admin Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Id: 1cd93ea5b05642848d07178b50fbac9f Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-Tenant-Name: admin Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User: admin Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Id: default Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Domain-Name: Default Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Id: 332151c44437481cb5ef58e0902276ac Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: X-User-Name: admin Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: method: > Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: exception: Flavor 451 could not be found. Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: action_args: {'id': '451'} Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 14:57:55.127070 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:55.129672 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: ERROR nova.api.openstack.wsgi Oct 21 14:57:55.130819 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-4996f791-0384-4da2-85eb-04203f24cf93 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 14:57:55.131845 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-4996f791-0384-4da2-85eb-04203f24cf93 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011901 Oct 21 14:57:55.131845 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 14:57:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 21 14:57:56.341478 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:56.342492 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 21 14:57:56.342929 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:56.866645 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-a6427f49-646b-4760-b0bd-cc5119e5c119 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:56.943161 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-a6427f49-646b-4760-b0bd-cc5119e5c119 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.463387 Oct 21 14:57:56.943708 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Oct 21 14:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:58.159371 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:58.160414 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Oct 21 14:57:58.160809 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:57:58.685572 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-27caabe8-c4f0-44aa-90a2-56c2b825d2e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:57:58.759248 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-27caabe8-c4f0-44aa-90a2-56c2b825d2e9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.457782 Oct 21 14:57:58.759801 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Oct 21 14:57:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:57:59.966099 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:57:59.967126 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Oct 21 14:57:59.967527 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:58:00.494424 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-af235e70-473e-4560-a98d-879aaa7bce46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:58:00.565215 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-af235e70-473e-4560-a98d-879aaa7bce46 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.458004 Oct 21 14:58:00.565694 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Oct 21 14:58:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:58:01.784720 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:58:01.785732 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Oct 21 14:58:01.786123 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:58:02.306940 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-72df5908-e793-40c3-862a-e181b66ef8c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 14:58:02.382568 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-72df5908-e793-40c3-862a-e181b66ef8c2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460400 Oct 21 14:58:02.383150 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Oct 21 14:58:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 14:58:03.606930 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:58:03.607944 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 21 14:58:03.608339 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 14:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:58:04.134133 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-d8607437-945b-4070-a943-ab8f519b15b0 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:58:04.155452 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-d8607437-945b-4070-a943-ab8f519b15b0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410053 Oct 21 14:58:04.156251 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Fri Oct 21 14:58:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:59:01.313341 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.314355 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-f8cc723d-5000-4a1b-9f73-9fc41f076736 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 21 14:59:01.314788 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 14:59:01.325442 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:59:01.708574 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-d0af9c0b-4877-4e08-a351-9b2cdec11c6b admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.728968 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-d0af9c0b-4877-4e08-a351-9b2cdec11c6b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407954 Oct 21 14:59:01.729512 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 14:59:01.751760 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_api:SELECT=14 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 14:59:01.755429 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-79b3af16-b7ce-4775-bab3-b4a880022bf5 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.762647 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-79b3af16-b7ce-4775-bab3-b4a880022bf5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012294 Oct 21 14:59:01.765653 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:59:01.775156 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-9a3866a0-90b3-4523-b66d-bf9254b83f55 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.782487 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-9a3866a0-90b3-4523-b66d-bf9254b83f55 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010889 Oct 21 14:59:01.783047 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:59:01.794773 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.802026 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011047 Oct 21 14:59:01.802546 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 14:59:01.814164 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-fd1c6b1a-170a-4ab0-a988-bbe32493cefa admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 14:59:01.821340 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-fd1c6b1a-170a-4ab0-a988-bbe32493cefa admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Oct 21 14:59:01.821853 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Fri Oct 21 14:59:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:02:12.043812 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:12.044831 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 21 15:02:12.045243 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 15:02:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:02:12.184752 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_api:SELECT=6 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:02:12.342149 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:12.346850 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:12.347326 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:12.347756 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:12.348465 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:12.348911 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:12.349328 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:12.381024 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-5cd51e3b-6669-48b1-9279-6f4fc9ce3525 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197519 Oct 21 15:02:12.381574 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 15:02:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:02:13.461959 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:13.463000 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 21 15:02:13.463393 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 15:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:02:13.656898 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:13.660355 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:13.660833 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:13.661294 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:13.662012 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:13.662752 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:13.668324 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:13.682421 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-ef6dd837-0662-48b2-954b-6ef3aa956a6a admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077796 Oct 21 15:02:13.683010 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 15:02:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:02:25.182823 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:25.183848 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 21 15:02:25.184247 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 15:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:02:25.328470 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_cell0:SELECT=4 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:02:25.329105 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_cell1:SELECT=4 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:02:25.329710 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG dbcounter [-] [104311] Writing DB stats nova_api:SELECT=8 {{(pid=104311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:02:25.377157 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:25.380584 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:25.381073 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:25.381508 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:25.382231 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:25.382711 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:25.383140 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:25.409172 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-a1f890ac-6552-4b11-82ee-b50c5c383ae4 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085174 Oct 21 15:02:25.409730 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 15:02:25 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:02:26.486345 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG nova.api.openstack.wsgi [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] Calling method '>' {{(pid=104312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:26.487408 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: INFO nova.api.openstack.requestlog [None req-b1a37b0b-4627-47ea-a52f-9d04820cd4c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 21 15:02:26.487807 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: [pid: 104312|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Oct 21 15:02:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:02:26.681359 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG nova.api.openstack.wsgi [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Calling method '>' {{(pid=104311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:02:26.684810 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:26.685319 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:26.685751 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:26.686466 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:02:26.686943 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:02:26.687368 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: DEBUG oslo_concurrency.lockutils [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:02:26.717666 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: INFO nova.api.openstack.requestlog [None req-652f3c97-45da-4156-89a4-2f73039e3a49 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080423 Oct 21 15:02:26.717666 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: [pid: 104311|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Oct 21 15:02:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:03:22.518536 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: Fri Oct 21 15:03:22 2022 - graceful shutdown triggered... Oct 21 15:03:22.519132 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: Gracefully killing worker 2 (pid: 104312)... Oct 21 15:03:22.518855 dv-cinder-836083-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 21 15:03:22.519964 dv-cinder-836083-16-iscsi devstack@n-api.service[104311]: Gracefully killing worker 1 (pid: 104311)... Oct 21 15:03:22.647672 dv-cinder-836083-16-iscsi devstack@n-api.service[104312]: DEBUG dbcounter [-] [104312] Writing DB stats nova_api:SELECT=4 {{(pid=104312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:03:23.519668 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: worker 1 buried after 1 seconds Oct 21 15:03:23.520211 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: worker 2 buried after 1 seconds Oct 21 15:03:23.520211 dv-cinder-836083-16-iscsi devstack@n-api.service[104310]: goodbye to uWSGI. Oct 21 15:03:23.521178 dv-cinder-836083-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 21 15:03:23.521722 dv-cinder-836083-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 21 15:03:23.524514 dv-cinder-836083-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 21 15:03:23.540121 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 21 15:03:23 2022] *** Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: nodename: dv-cinder-836083-16-iscsi Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: machine: x86_64 Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: clock source: unix Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: pcre jit disabled Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: detected number of CPU cores: 4 Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: current working directory: / Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: detected binary path: /usr/bin/uwsgi-core Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: your processes number limit is 47680 Oct 21 15:03:23.542080 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: your memory page size is 4096 bytes Oct 21 15:03:23.543277 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: detected max file descriptor number: 2048 Oct 21 15:03:23.543277 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: lock engine: pthread robust mutexes Oct 21 15:03:23.543277 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: thunder lock: enabled Oct 21 15:03:23.543277 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 21 15:03:23.543277 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 21 15:03:23.582700 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: Python main interpreter initialized at 0x55579829d9c0 Oct 21 15:03:23.582700 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: python threads support enabled Oct 21 15:03:23.582700 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: your server socket listen backlog is limited to 100 connections Oct 21 15:03:23.582700 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: your mercy for graceful operations on workers is 90 seconds Oct 21 15:03:23.583133 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: mapped 403077 bytes (393 KB) for 2 cores Oct 21 15:03:23.583133 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: *** Operational MODE: preforking *** Oct 21 15:03:23.583395 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: *** uWSGI is running in multiple interpreter mode *** Oct 21 15:03:23.583395 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: spawned uWSGI master process (pid: 119345) Oct 21 15:03:23.583600 dv-cinder-836083-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 21 15:03:23.584188 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: spawned uWSGI worker 1 (pid: 119357, cores: 1) Oct 21 15:03:23.584680 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: spawned uWSGI worker 2 (pid: 119358, cores: 1) Oct 21 15:03:23.584971 dv-cinder-836083-16-iscsi devstack@n-api.service[119345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 21 15:03:24.248875 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 21 15:03:24.264487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 21 15:03:25.428856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 15:03:25.428856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: from cryptography.utils import int_from_bytes Oct 21 15:03:25.429449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 15:03:25.429449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: from cryptography.utils import int_from_bytes Oct 21 15:03:25.436333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 15:03:25.436333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: from cryptography.utils import int_from_bytes Oct 21 15:03:25.436817 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 15:03:25.436817 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: from cryptography.utils import int_from_bytes Oct 21 15:03:27.869144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 15:03:27.869692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 15:03:27.870539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 15:03:27.870943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 15:03:27.871204 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 15:03:27.871597 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.871928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.872429 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.872741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.873079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.873396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.873721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.874042 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.874381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.874661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.874985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.875319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-16-iscsi {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.875645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.875958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.876270 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.876594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.876900 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.877227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.877539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.878044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.879524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.879524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.879524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.879794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 15:03:27.880631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.880715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 15:03:27.880818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.880818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.880978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 15:03:27.881068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.881150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 15:03:27.881150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 15:03:27.881672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.881672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.881827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.882107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.882354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.882596 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-16-iscsi {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.882861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.883078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.883303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.883519 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.883748 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.883965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.884186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.884408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.884628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.884845 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.885068 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.885293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.885671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.885956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.886219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.886523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.886755 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.886988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.887174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-16-iscsi {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.887396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.887600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.887757 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.887903 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.888841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.889883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.890939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.891092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.891247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.891407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.891553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.891698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.892194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.892361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.892516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.892671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.893395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.893873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894462 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.894979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.895253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-16-iscsi {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.895599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.895757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.896963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.897900 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.898852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899164 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899452 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.899898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900050 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900335 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.900970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.901997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.902316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.902467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.902645 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.902810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.902810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.903863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904771 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.904931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.905985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.906137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.906289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.906433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.906583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.906899 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.907072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.907216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.907359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.908456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.908558 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.908907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.908907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.908907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909138 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.909670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910278 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910362 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.910974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911526 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911704 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911868 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.911950 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912032 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912328 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912668 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912753 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.912918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.913985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.914928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915291 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.915999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.916083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.916172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.916257 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.916356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.916446 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.917123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.917297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.917454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.917602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.917750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.917886 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.918065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.918169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.918394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.918501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.918730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.918829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.919043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.919145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.919368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.919463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.919683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.919777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.919992 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.920091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.920313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.920414 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.920616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.920714 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.920929 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.921022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.921255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.921349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.921566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.921667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.921877 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.921978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.922186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.922324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.922588 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.922697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.922798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.922894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.923112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.923205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.923422 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.923516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.923736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.923917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.924076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.924219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.924364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.924514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.924666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.924816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.924956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.925110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.925250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.925404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.925551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.925702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.925863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 15:03:27.926013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.926203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.926352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.926543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.926704 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.926920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.927894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928627 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.928939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.929874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.930872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.931798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.932013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.932113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.932975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.933073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.933343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.933437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.933688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.933781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.934996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935503 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.935952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.936995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937164 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937640 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937787 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.937954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.938969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.939963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940547 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.940975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941704 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.941842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942472 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942625 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.942980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943616 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943722 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.943942 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.944977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945606 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.945898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946529 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.946858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.947846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.948104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.948197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.948750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.952980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953208 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.953894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954120 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954872 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.954967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955584 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.955926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.956906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957259 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957668 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.957977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.958807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959062 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959859 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.959950 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.960919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961537 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961749 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.961850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962066 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.962829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963156 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.963851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964420 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.964948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.965983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.966197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.966296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.966512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.966604 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.966848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.967871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968488 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968714 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.968850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969752 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.969968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970366 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.970930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.971943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.972888 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.973854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.974061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.974171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.974367 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.974468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.974912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975625 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.975934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976024 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.976943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.977999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978182 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.978961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.979585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.979661 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.979927 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.980218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.980331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.980465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.980569 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981237 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981603 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981706 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.981949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982022 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.982831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.983950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984094 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.984882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.985906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.986949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987356 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.987916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988201 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.988978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.989980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.990969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.991101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.991293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.991426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.991601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.991757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.992902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.993826 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.994008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.994151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.994320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.994463 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.994696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.995328 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.995546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.995762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.995906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.996963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.997950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.998913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999058 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999320 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999621 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:27.999940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.000897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001046 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.001956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002253 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.002914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003069 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003359 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.003979 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.004887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.005974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006571 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.006963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.007866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.008897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.009859 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.010017 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.010163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.010350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.010499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.010840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.011957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.012886 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013516 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.013962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.014875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015259 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.015965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.016197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.016384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.016534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.016768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.016922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017544 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.017860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018188 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.018837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.019848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.020791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021783 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.021939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022772 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.022935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023678 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.023977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024429 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.024871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.025795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.026758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.026973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027281 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.027878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028792 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.028952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.029956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.030958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031826 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.031972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032429 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.032907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.033961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.034875 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035019 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.035921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.036997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037609 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037754 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.037899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.038057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.038481 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.038670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.038854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039573 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.039880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040632 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.040939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.041094 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.041361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.041556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042666 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.042963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.043870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044472 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.044925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.045848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046084 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.046973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047508 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.047971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048118 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.048875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049021 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049714 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.049874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.050502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.050697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.050852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.051887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052047 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.052967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053119 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053714 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.053868 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054322 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.054999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.055876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.056941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.057206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.057428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.057595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.057742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.057896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058508 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.058885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.059728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.060958 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.061879 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.062850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063007 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063155 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.063909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.064944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065388 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.065999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066473 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066791 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.066948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.067093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.067352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.067612 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.067767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.067922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068069 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.068992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069839 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.069993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070155 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070814 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.070971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071729 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.071880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072034 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.072974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073155 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.073968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.074243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.074425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.074710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.074880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075036 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.075874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076609 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.076909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.077055 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.077200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.077369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.077619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.077843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078816 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.078973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.079256 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.079411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.079557 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.079711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.079882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.080104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.080264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.080426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.080620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.080797 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081371 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081720 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.081876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.082987 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.083891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084791 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.084944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.085884 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.086700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.087021 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.087182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.087335 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.087494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.087746 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.088006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.088167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.088329 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.089905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.090907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091323 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091629 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.091852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.092955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.093982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094617 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.094958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095156 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095259 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.095920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.096825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097034 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097753 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.097967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.098915 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.099928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.100869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101097 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101516 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101749 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.101849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102055 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102703 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.102810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103422 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.103824 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.104025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.104762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.104919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105230 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.105876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106036 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.106916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107728 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.107879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108829 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.108988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.109939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110587 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110785 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.110955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.111110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.111271 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.111443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.111686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.111846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112769 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.112937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.113924 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.114673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.114800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.114894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115397 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.115921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116888 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.116980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117361 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117462 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.117854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118501 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.118999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.119334 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.119787 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.120239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.120505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.121348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.122095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.122432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.122829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.123105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.123301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.123478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.123651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.123829 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124034 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.124850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.125980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.126142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.126312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.126471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.126626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.126851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.127979 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.128133 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.128300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.128461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.128643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.129006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.129193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.129461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.129705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.129910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.130077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.130243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.130487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.130801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.131123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.131336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.131506 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.131711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.132020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.132338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.132512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.132679 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.132833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133704 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.133898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.134938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.135343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.135512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.135684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.135844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.136856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.137218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.138794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.138794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.138794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.138794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.138794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.140935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.141298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.141575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.141801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.142065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.142655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.142962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.143326 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.143652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.144056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.144427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.144753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.145079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.145449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.145769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.146098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.146420 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.146857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.147186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.147517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.147853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.148193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.148510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.148848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.149183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.149856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.150190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.150546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.151632 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.152465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.152465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.152779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 15:03:28.153033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 15:03:28.201232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO dbcounter [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Registered counter for database nova_api Oct 21 15:03:28.218332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO dbcounter [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Registered counter for database nova_api Oct 21 15:03:28.222473 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.230795 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writer thread running {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.239503 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_db.sqlalchemy.engines [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.246325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writer thread running {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.291006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.context [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc1fe804-a1c0-4f42-88c1-97d74249e7fa(cell1) {{(pid=119358) load_cells /opt/stack/nova/nova/context.py:464}} Oct 21 15:03:28.296233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:03:28.299179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:03:28.299179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:03:28.299179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:03:28.299619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:03:28.301692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:03:28.303789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO dbcounter [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Registered counter for database nova_cell0 Oct 21 15:03:28.304534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.context [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc1fe804-a1c0-4f42-88c1-97d74249e7fa(cell1) {{(pid=119357) load_cells /opt/stack/nova/nova/context.py:464}} Oct 21 15:03:28.308187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO dbcounter [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Registered counter for database nova_cell1 Oct 21 15:03:28.308902 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:03:28.309393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:03:28.311035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:03:28.311758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:03:28.312212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:03:28.314246 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:03:28.316202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.316364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO dbcounter [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Registered counter for database nova_cell0 Oct 21 15:03:28.317686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.320983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO dbcounter [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Registered counter for database nova_cell1 Oct 21 15:03:28.323857 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writer thread running {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.328890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_db.sqlalchemy.engines [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.330659 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_db.sqlalchemy.engines [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.336213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writer thread running {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.342570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writer thread running {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.477961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writer thread running {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.488667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO dbcounter [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Registered counter for database nova_cell0 Oct 21 15:03:28.496607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.497777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO dbcounter [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Registered counter for database nova_cell0 Oct 21 15:03:28.501998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writer thread running {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.504789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_db.sqlalchemy.engines [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 15:03:28.509523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writer thread running {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 15:03:28.826509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: WARNING keystonemiddleware.auth_token [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 15:03:28.833794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: WARNING keystonemiddleware.auth_token [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 15:03:28.836935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: WARNING keystonemiddleware.auth_token [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 15:03:28.844939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: WARNING keystonemiddleware.auth_token [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 15:03:29.185279 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: WARNING keystonemiddleware.auth_token [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 15:03:29.191344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: WARNING keystonemiddleware.auth_token [None req-c72c55d4-cf12-4060-910d-1b8e5b4fd695 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 15:03:29.196537 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: WARNING keystonemiddleware.auth_token [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 21 15:03:29.196947 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55579829d9c0 pid: 119358 (default app) Oct 21 15:03:29.203285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: WARNING keystonemiddleware.auth_token [None req-3f18df02-1f89-4939-9317-bfe8af3b3e6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 21 15:03:29.208784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55579829d9c0 pid: 119357 (default app) Oct 21 15:04:07.181384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.182252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.183215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.183840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.673776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.677662 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.680132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:07.681311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:08.552552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-53731d17-3070-4787-8c5d-565f427260ab tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Action: 'create', calling method: .version_select at 0x7fd1e1de2ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-865526515"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:08.714457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-99fc37ba-5492-4359-834c-953a8d4f4ec3 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Action: 'create', calling method: .version_select at 0x7fd1e1ddef70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1106561691", "metadata": {"Type": "work"}}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:11.113697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-53731d17-3070-4787-8c5d-565f427260ab tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.949892 Oct 21 15:04:11.118139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Fri Oct 21 15:04:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3956 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 21 15:04:11.139174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-11bb5798-c3c1-419c-9420-852c7aeeaebd tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1c46d30>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:11.207674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-99fc37ba-5492-4359-834c-953a8d4f4ec3 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.548156 Oct 21 15:04:11.218727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Oct 21 15:04:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3551 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 21 15:04:11.228882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-662d0bb7-225c-420d-a170-6f0e5425c57a tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1c45dc0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:11.672073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-11bb5798-c3c1-419c-9420-852c7aeeaebd tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 200 len: 344 microversion: 2.1 time: 0.543052 Oct 21 15:04:11.678977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:11 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 344 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:11.775844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-662d0bb7-225c-420d-a170-6f0e5425c57a tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 200 len: 353 microversion: 2.1 time: 0.551717 Oct 21 15:04:11.776518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:11 2022] GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 353 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:12.686891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7b1c1549-e565-4990-8228-4933fd72f713 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd9430>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:12.791101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-baa64dca-2b73-4e30-8cd7-16ce099de081 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1bd94c0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:12.808419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7b1c1549-e565-4990-8228-4933fd72f713 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 200 len: 345 microversion: 2.1 time: 0.125140 Oct 21 15:04:12.809458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:12 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:12.822882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8f7c910f-e046-43d6-84dd-40127ad4ff60 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Action: 'create', calling method: .version_select at 0x7fd1e1bd9a60>, body: {"snapshot": {"volume_id": "2c187842-f409-4416-8152-a667a4b659d5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-501488563"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:12.938048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-baa64dca-2b73-4e30-8cd7-16ce099de081 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 200 len: 354 microversion: 2.1 time: 0.151165 Oct 21 15:04:12.947052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:12 2022] GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:12.953266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-917b9bec-9862-46b9-a655-d4eb9310f992 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1bd9b80>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:13.168726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-917b9bec-9862-46b9-a655-d4eb9310f992 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 200 len: 354 microversion: 2.1 time: 0.220396 Oct 21 15:04:13.169655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:12 2022] GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:13.198254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f0bbfec4-e3a2-4732-818b-6d8c5b23d490 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1c45d30>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:13.783063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f0bbfec4-e3a2-4732-818b-6d8c5b23d490 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 202 len: 0 microversion: 2.1 time: 0.589226 Oct 21 15:04:13.783063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:04:13 2022] DELETE /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:04:13.787415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8f7c910f-e046-43d6-84dd-40127ad4ff60 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.968879 Oct 21 15:04:13.789419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 4/9] 10.222.0.60 () {60 vars in 1162 bytes} [Fri Oct 21 15:04:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:13.801392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e093b1df-4d9c-46bf-8d21-2ef2de98e002 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd9b80>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:13.809755 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bb311ca0-3b01-437a-85ae-8a77dc8486a0 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1bd9a60>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:14.123858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e093b1df-4d9c-46bf-8d21-2ef2de98e002 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 286 microversion: 2.1 time: 0.325283 Oct 21 15:04:14.124349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 5/10] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:13 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 286 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:14.134906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bc73fbd8-1693-4d48-9ae9-f47fe210146d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd94c0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:14.290756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bb311ca0-3b01-437a-85ae-8a77dc8486a0 tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 200 len: 353 microversion: 2.1 time: 0.503648 Oct 21 15:04:14.291274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:13 2022] GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 353 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:14.493666 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bc73fbd8-1693-4d48-9ae9-f47fe210146d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.358052 Oct 21 15:04:14.493666 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Oct 21 15:04:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:14.503351 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-628a7dba-c2ec-4e00-8fc2-6a6c093b31d6 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd93a0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:14.946029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-628a7dba-c2ec-4e00-8fc2-6a6c093b31d6 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 286 microversion: 2.1 time: 0.444442 Oct 21 15:04:14.946029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:14 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 286 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:15.313510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-92806d88-0419-46eb-819a-6f71fc20af7c tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Calling method '.version_select at 0x7fd1e1bd6310>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:15.493848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-92806d88-0419-46eb-819a-6f71fc20af7c tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] HTTP exception thrown: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-92806d88-0419-46eb-819a-6f71fc20af7c tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Request method failure captured: Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 HTTP/1.1 Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTnJ7rjwhFPijrt7iqvKAealSlca8g0NHKeEtLq6wjJCEAUiS5jzVYL5Ag3I6_APU4dp7pae4AurzcZJYfPOQjct6bD3q8VbWOwnAw1xcdUNfpQbFjyuX3VJZCfZPGUgUkQETJqC0NXR61_GYipmhRaZ-Qh1TeOT46S7UrgiijE_tg Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: dc7f82673a5c4e44af476123af54e37f Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesGetTestJSON-1707162994 Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:04:15.500924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dc7f82673a5c4e44af476123af54e37f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dc7f82673a5c4e44af476123af54e37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dc7f82673a5c4e44af476123af54e37f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dc7f82673a5c4e44af476123af54e37f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesGetTestJSON-1707162994 Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: dc7f82673a5c4e44af476123af54e37f Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesGetTestJSON-1707162994 Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesGetTestJSON-1707162994-project Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: e4c2c66a664b4b5d90ba77dd69fda0ac Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesGetTestJSON-1707162994-project Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'dc7f9bc6-499c-44c9-91f7-bd5681f564f2'} Oct 21 15:04:15.502314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. (HTTP 404) (Request-ID: req-817ac966-b2f5-4434-9e34-f4be7a5e7b4f) Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:15.512292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:15.514113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 21 15:04:15.515307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-92806d88-0419-46eb-819a-6f71fc20af7c tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] Returning 404 to user: Volume dc7f9bc6-499c-44c9-91f7-bd5681f564f2 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-92806d88-0419-46eb-819a-6f71fc20af7c tempest-VolumesGetTestJSON-1707162994 tempest-VolumesGetTestJSON-1707162994-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2" status: 404 len: 109 microversion: 2.1 time: 0.203129 Oct 21 15:04:15.516410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 7/14] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:15 2022] GET /compute/v2.1/os-volumes/dc7f9bc6-499c-44c9-91f7-bd5681f564f2 => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:04:15.969914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8430944f-fead-4be1-9eed-22e69b26d50e tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd9430>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:16.051798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8430944f-fead-4be1-9eed-22e69b26d50e tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 286 microversion: 2.1 time: 0.099249 Oct 21 15:04:16.052864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 8/15] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:15 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:17.065315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e16296fb-af01-433d-9a87-0aa4feedc801 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd6550>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:17.110473 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e16296fb-af01-433d-9a87-0aa4feedc801 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 286 microversion: 2.1 time: 0.049590 Oct 21 15:04:17.111059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:17 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:18.125594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eb838a91-125d-4047-9254-a27438ee524d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd9a60>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:18.182719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eb838a91-125d-4047-9254-a27438ee524d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 287 microversion: 2.1 time: 0.063033 Oct 21 15:04:18.185871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 9/17] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:18 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:18.195565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6a221ac9-d098-4a64-b21c-1b43e9cbffcf tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1c46af0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:18.399245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6a221ac9-d098-4a64-b21c-1b43e9cbffcf tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 202 len: 0 microversion: 2.1 time: 0.204719 Oct 21 15:04:18.401169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 9/18] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Oct 21 15:04:18 2022] DELETE /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:04:18.410870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3271242f-de10-4ba5-bb1d-781447579207 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd6040>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:18.480312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3271242f-de10-4ba5-bb1d-781447579207 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 200 len: 286 microversion: 2.1 time: 0.073388 Oct 21 15:04:18.481572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 10/19] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:18 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:18.598216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-425806031", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:18.893635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] validate_networks() for [('5c23ba3a-efd7-4124-a78d-7daa57f2b1c1', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:04:19.493920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d35a237d-36cc-4084-bdce-9c5d5da64418 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd6e50>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:19.645182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-d35a237d-36cc-4084-bdce-9c5d5da64418 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] HTTP exception thrown: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d35a237d-36cc-4084-bdce-9c5d5da64418 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Request method failure captured: Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 HTTP/1.1 Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTn4Ypt6Yk8Uhk-PD0Vtjaf39qKHp5XYzRC7IesO8W8OXqkD2agnKF3ryzyjlvmuJ4g8Tr1xwFTd_VgwmfZtRQCTKoPh0_QQwdlM4lg4M_WRbeYiWYmPkANEw6GGnNIfmDC9g5YbGuFTKkNEwVTvvG7HmT1idLyHZ567yDaYOFgXBY Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:04:19.647995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5bfb34191974243b44928b969219ede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5bfb34191974243b44928b969219ede", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 33741caefb3b4d2f954f1914647b6c79 Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '1ab39ec4-4ce5-48a2-a86b-a30f7ac15887'} Oct 21 15:04:19.649672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. (HTTP 404) (Request-ID: req-02540059-38de-48b6-ad5f-0ec91d3efa5a) Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.650977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:19.652220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 21 15:04:19.653338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. Oct 21 15:04:19.654594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:19.657310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d35a237d-36cc-4084-bdce-9c5d5da64418 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Returning 404 to user: Snapshot 1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:04:19.658365 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d35a237d-36cc-4084-bdce-9c5d5da64418 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887" status: 404 len: 111 microversion: 2.1 time: 0.168827 Oct 21 15:04:19.659550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 11/20] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:04:19 2022] GET /compute/v2.1/os-snapshots/1ab39ec4-4ce5-48a2-a86b-a30f7ac15887 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:04:19.668119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7316cf05-5385-4ed7-98a4-840be49d48ae tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1bd65e0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:20.015782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7316cf05-5385-4ed7-98a4-840be49d48ae tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 202 len: 0 microversion: 2.1 time: 0.351732 Oct 21 15:04:20.016353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 12/21] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:04:19 2022] DELETE /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:04:20.026155 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7cd379d2-24d7-4d0f-ab6f-05846aa3d874 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e25c53a0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:20.169818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7cd379d2-24d7-4d0f-ab6f-05846aa3d874 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 200 len: 344 microversion: 2.1 time: 0.145093 Oct 21 15:04:20.169818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 13/22] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:20 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:21.181631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4fdadde1-2a70-4bc0-87af-c4d28ad3072e tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1b4b700>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:21.305254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4fdadde1-2a70-4bc0-87af-c4d28ad3072e tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 200 len: 344 microversion: 2.1 time: 0.127273 Oct 21 15:04:21.312824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 14/23] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:21 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:21.853590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:04:21.854116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:04:21.855876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:04:21.860692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:04:21.860692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:04:21.875977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6d865c27-e4f3-46bb-9498-6d317929ac97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: .version_select at 0x7fd1e1bd69d0>, body: {"keypair": {"name": "tempest-keypair-2123397004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObFVHMyoL6m6GDLmrF+UzdEqFzWmmFJwqp9dkaeESqxHNXphjAL1rBh4mv9STH/8BfKgUY6Rz9fc9LGo/+amWmX3VFA6yMiQfdxOcpMPea4F8yJpfBEL2iYKHuoorQOGg=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:21.894942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:21.895404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:21.903312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:21.904127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:21.904625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:21.905005 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:21.986885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:21.987597 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-6d865c27-e4f3-46bb-9498-6d317929ac97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:21.993890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for user 8632f75445ef4fd3a2f1ebbc2ed87e5b and project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:22.000540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-6d865c27-e4f3-46bb-9498-6d317929ac97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:22.015226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:04:22.022575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:04:22.220193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6d865c27-e4f3-46bb-9498-6d317929ac97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.589766 Oct 21 15:04:22.227031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 15/24] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:04:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:22.324583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6d694842-f14e-4de7-ae2a-5829c040eadd tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1b2bd30>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:22.383512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cde1b7b9-18e4-4c94-8b45-03dd94dff3fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.102619 Oct 21 15:04:22.391468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 10/25] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:04:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 4111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:04:22.416880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-be3ba53c-9fdc-49bb-897c-c78c83f651ce tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:22.422982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-be3ba53c-9fdc-49bb-897c-c78c83f651ce tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:22.521726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6d694842-f14e-4de7-ae2a-5829c040eadd tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 200 len: 344 microversion: 2.1 time: 0.200982 Oct 21 15:04:22.521726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 16/26] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:22 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:22.678341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-be3ba53c-9fdc-49bb-897c-c78c83f651ce tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:22.704363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-be3ba53c-9fdc-49bb-897c-c78c83f651ce tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1221 microversion: 2.1 time: 0.295250 Oct 21 15:04:22.704363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 11/27] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:22 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:23.721153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8335c146-0096-4a59-afef-2931e4578540 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: .version_select at 0x7fd1e1ae53a0>, body: {"keypair": {"name": "tempest-keypair-987788660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHePqIt8tYJ2wuR3bRRFV9NblZSCHJoLc97pC1ShCZCDAoKGZQ52XkqpfotbyjJJk4UWt2+6tlVKZfb3FlG5MOMQWfIDgMLjU9hWCKiFkwkRoxVlotTNtdZuh47NL29mzw=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:23.731046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-265663591", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:23.746988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-8335c146-0096-4a59-afef-2931e4578540 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for project c83d10829a81437fb4d56fe488581212. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:23.746988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-8335c146-0096-4a59-afef-2931e4578540 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for user 4593c3fd1739432fa57f4a94c65cd299 and project c83d10829a81437fb4d56fe488581212. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:23.748836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] validate_networks() for [('5c23ba3a-efd7-4124-a78d-7daa57f2b1c1', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:04:23.749070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8335c146-0096-4a59-afef-2931e4578540 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.035597 Oct 21 15:04:23.749070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 17/28] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Oct 21 15:04:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1037 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 21 15:04:23.787018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bf30eb02-5481-4e2f-b774-9456be195557 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1ae54c0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:23.886400 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-bf30eb02-5481-4e2f-b774-9456be195557 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] HTTP exception thrown: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bf30eb02-5481-4e2f-b774-9456be195557 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Request method failure captured: Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 HTTP/1.1 Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTn4Ypt6Yk8Uhk-PD0Vtjaf39qKHp5XYzRC7IesO8W8OXqkD2agnKF3ryzyjlvmuJ4g8Tr1xwFTd_VgwmfZtRQCTKoPh0_QQwdlM4lg4M_WRbeYiWYmPkANEw6GGnNIfmDC9g5YbGuFTKkNEwVTvvG7HmT1idLyHZ567yDaYOFgXBY Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:04:23.892969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5bfb34191974243b44928b969219ede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5bfb34191974243b44928b969219ede", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 33741caefb3b4d2f954f1914647b6c79 Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '2c187842-f409-4416-8152-a667a4b659d5'} Oct 21 15:04:23.894074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. (HTTP 404) (Request-ID: req-93b6d156-11ce-46bf-8f64-12e3735f0db1) Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.895158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:23.896033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 21 15:04:23.896837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bf30eb02-5481-4e2f-b774-9456be195557 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Returning 404 to user: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bf30eb02-5481-4e2f-b774-9456be195557 tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 404 len: 109 microversion: 2.1 time: 0.139267 Oct 21 15:04:23.897717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 18/29] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:23 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:04:23.914471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69012368-ea0f-46b1-ae76-0a9376fe1d7d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1b2b700>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:23.965768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-69012368-ea0f-46b1-ae76-0a9376fe1d7d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] HTTP exception thrown: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69012368-ea0f-46b1-ae76-0a9376fe1d7d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Request method failure captured: Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 HTTP/1.1 Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTn4Ypt6Yk8Uhk-PD0Vtjaf39qKHp5XYzRC7IesO8W8OXqkD2agnKF3ryzyjlvmuJ4g8Tr1xwFTd_VgwmfZtRQCTKoPh0_QQwdlM4lg4M_WRbeYiWYmPkANEw6GGnNIfmDC9g5YbGuFTKkNEwVTvvG7HmT1idLyHZ567yDaYOFgXBY Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:04:23.968027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5bfb34191974243b44928b969219ede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5bfb34191974243b44928b969219ede", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 33741caefb3b4d2f954f1914647b6c79 Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '2c187842-f409-4416-8152-a667a4b659d5'} Oct 21 15:04:23.969071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. (HTTP 404) (Request-ID: req-94c99623-da44-4d54-b515-696343b7493a) Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.969641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:04:23.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 21 15:04:23.972698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:23.975673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.000948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69012368-ea0f-46b1-ae76-0a9376fe1d7d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Returning 404 to user: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:04:24.009005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-69012368-ea0f-46b1-ae76-0a9376fe1d7d tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 404 len: 109 microversion: 2.1 time: 0.100791 Oct 21 15:04:24.015282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 19/30] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:04:23 2022] DELETE /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:04:24.027692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ff855444-621f-4f6d-b823-11cf724ecaea tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Calling method '.version_select at 0x7fd1e1ae5dc0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-ff855444-621f-4f6d-b823-11cf724ecaea tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] HTTP exception thrown: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ff855444-621f-4f6d-b823-11cf724ecaea tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Request method failure captured: Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 HTTP/1.1 Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTn4Ypt6Yk8Uhk-PD0Vtjaf39qKHp5XYzRC7IesO8W8OXqkD2agnKF3ryzyjlvmuJ4g8Tr1xwFTd_VgwmfZtRQCTKoPh0_QQwdlM4lg4M_WRbeYiWYmPkANEw6GGnNIfmDC9g5YbGuFTKkNEwVTvvG7HmT1idLyHZ567yDaYOFgXBY Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:04:24.095535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5bfb34191974243b44928b969219ede"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5bfb34191974243b44928b969219ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5bfb34191974243b44928b969219ede", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: d5bfb34191974243b44928b969219ede Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540689484 Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 33741caefb3b4d2f954f1914647b6c79 Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540689484-project Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '2c187842-f409-4416-8152-a667a4b659d5'} Oct 21 15:04:24.096768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. (HTTP 404) (Request-ID: req-0c7f1f15-b7d2-4d4a-b939-26c16edc5680) Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:24.097575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:04:24.098689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 21 15:04:24.100431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ff855444-621f-4f6d-b823-11cf724ecaea tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] Returning 404 to user: Volume 2c187842-f409-4416-8152-a667a4b659d5 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ff855444-621f-4f6d-b823-11cf724ecaea tempest-VolumesSnapshotsTestJSON-540689484 tempest-VolumesSnapshotsTestJSON-540689484-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5" status: 404 len: 109 microversion: 2.1 time: 0.077600 Oct 21 15:04:24.102396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 20/31] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:24 2022] GET /compute/v2.1/os-volumes/2c187842-f409-4416-8152-a667a4b659d5 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:04:24.716444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1397487814", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "networks": [{"uuid": "85d8cd54-8839-4401-b661-12967a52617c"}]}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:24.891047 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] validate_networks() for [('85d8cd54-8839-4401-b661-12967a52617c', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:04:24.985039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:04:24.987637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:04:24.988371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:04:24.989006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:04:24.989818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:04:25.012125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:25.018502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:25.024929 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:25.029419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:25.035133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:25.038517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:25.110537 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:25.119560 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for user 8632f75445ef4fd3a2f1ebbc2ed87e5b and project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:25.141358 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:04:25.145044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:04:25.473216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c03a0809-70ed-4d2a-a6ab-0ed87a16d36a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.064022 Oct 21 15:04:25.488357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 12/32] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:04:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:04:25.494092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-443bad08-c4d1-4dba-8760-1480497bdc6b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:25.496296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-443bad08-c4d1-4dba-8760-1480497bdc6b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:25.638217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-443bad08-c4d1-4dba-8760-1480497bdc6b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:25.655449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-443bad08-c4d1-4dba-8760-1480497bdc6b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1221 microversion: 2.1 time: 0.164244 Oct 21 15:04:25.679903 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 13/33] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:25 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:26.681558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fde53356-c0af-4b71-b86f-cdbd506fc565 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:26.682194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fde53356-c0af-4b71-b86f-cdbd506fc565 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:27.239904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fde53356-c0af-4b71-b86f-cdbd506fc565 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:27.259963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fde53356-c0af-4b71-b86f-cdbd506fc565 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1221 microversion: 2.1 time: 0.582521 Oct 21 15:04:27.262693 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 14/34] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:26 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1221 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:27.566557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:04:27.567698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:04:27.568272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:04:27.568752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:04:27.569217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:04:27.613671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:27.614552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:27.617534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:27.623835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:27.625163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:27.627853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:27.710417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Getting quotas for project 6406e245a2fd4700aebba95795a18632. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:27.716465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Getting quotas for user c82ec83bb124455693573e6c68ff12fb and project 6406e245a2fd4700aebba95795a18632. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:27.732686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:04:27.737210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:04:28.093903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7bfa49af-356a-4d6c-8df7-700e25e38fec tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.914926 Oct 21 15:04:28.096053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 21/35] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:04:28.126973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-55d0eb55-c3fe-489e-b152-b9728c912d04 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:28.128250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-55d0eb55-c3fe-489e-b152-b9728c912d04 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:28.300508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:28.301206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:28.317616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-55d0eb55-c3fe-489e-b152-b9728c912d04 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:28.326376 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-55d0eb55-c3fe-489e-b152-b9728c912d04 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1215 microversion: 2.1 time: 0.223293 Oct 21 15:04:28.330735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 15/36] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:28 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:28.369045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:28.370165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:28.371533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:28.372482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:28.373146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:28.373814 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:28.801351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:28.821075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-698a247f-29c9-4ee1-8f9c-852fae2cf2b7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1225 microversion: 2.1 time: 0.531467 Oct 21 15:04:28.822276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 22/37] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:28 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1225 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:29.363243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6d90c885-838e-4415-8165-b9413b3f5a46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:29.363862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6d90c885-838e-4415-8165-b9413b3f5a46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:29.606614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6d90c885-838e-4415-8165-b9413b3f5a46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:29.613652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6d90c885-838e-4415-8165-b9413b3f5a46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1215 microversion: 2.1 time: 0.254163 Oct 21 15:04:29.618789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 16/38] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:29 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:29.860571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:29.860571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:29.860571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:29.866015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:29.866742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:29.867875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:29.868167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:29.868590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:30.051225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:30.064838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0079b010-03e1-44d8-aa2d-28726f5d6aca tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1273 microversion: 2.1 time: 0.222368 Oct 21 15:04:30.067933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 23/39] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:29 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:30.580076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-687209959", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea25e75c-f122-4224-a461-b96ad815c898"}], "security_groups": [{"name": "tempest-securitygroup--818987700"}], "key_name": "tempest-keypair-987788660", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:30.648130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:30.649133 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:30.667454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:30.669585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:30.670409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:30.673531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:30.675307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:30.675934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:30.911700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:30.926733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f721abc4-2acd-4ac5-abb5-53bb80e9aee4 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1219 microversion: 2.1 time: 0.280906 Oct 21 15:04:30.927578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 24/40] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:30 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:30.960583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-94050864", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0eade66-a654-457b-8b3f-068b28484861"}], "security_groups": [{"name": "tempest-securitygroup--1385148203"}], "key_name": "tempest-keypair-2123397004", "user_data": "}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:30.973319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] validate_networks() for [('ea25e75c-f122-4224-a461-b96ad815c898', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:04:31.647321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] validate_networks() for [('b0eade66-a654-457b-8b3f-068b28484861', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:04:32.779993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:04:32.780570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:04:32.781055 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:04:32.781594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:04:32.782017 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:04:32.819245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:32.822559 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:32.823903 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:32.830165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:32.833492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:32.835026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:32.923648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for project c83d10829a81437fb4d56fe488581212. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:32.941865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for user 4593c3fd1739432fa57f4a94c65cd299 and project c83d10829a81437fb4d56fe488581212. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:32.986051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:04:32.999097 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:04:33.574962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a64ae69a-ae38-4a9d-a32c-be2e32a90b6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.998252 Oct 21 15:04:33.576786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 17/41] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Oct 21 15:04:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3003 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 21 15:04:33.588339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:33.591272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:33.609047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:33.613497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:33.618405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:33.670584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:33.676664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:33.694989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:33.961851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:04:33.962437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:04:33.962952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:04:33.964284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:04:33.964398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:04:33.989962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:33.989962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:33.989962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:33.989962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:34.007814 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:34.008619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:34.087394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:04:34.098872 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:04:34.118763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:04:34.134471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:04:34.388921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-21c8d57e-4b75-47f1-9471-ca507a5cdb92 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.443700 Oct 21 15:04:34.389613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 25/42] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:04:34.397622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:34.398687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:34.444980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:34.445518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:34.445969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:34.446716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:34.471544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:34.473527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:34.817971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:34.826960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2f8cf18f-9df2-44c6-ab3d-f87bc867ddc7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1273 microversion: 2.1 time: 0.436018 Oct 21 15:04:34.868539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 26/43] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:34 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1273 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:34.895052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:34.896138 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:34.947048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:34.955218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-858cc273-66cc-442d-bceb-ba24e99725bf tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 1.376172 Oct 21 15:04:34.964585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 18/44] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:33 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:34.986720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b2d19668-e25f-40a6-9cd6-e9a471343ccd tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e122ba60>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:35.083089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b2d19668-e25f-40a6-9cd6-e9a471343ccd tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6aae1c97-2fe8-442c-9d91-866f47dd740a" status: 200 len: 350 microversion: 2.1 time: 0.111423 Oct 21 15:04:35.083956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 19/45] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:34 2022] GET /compute/v2.1/os-volumes/6aae1c97-2fe8-442c-9d91-866f47dd740a => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:35.101904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6592a965-28d8-43a6-8ba7-a071aa04cd3b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:35.101904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6592a965-28d8-43a6-8ba7-a071aa04cd3b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:35.153078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:35.179928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:35.187256 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:35.188792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d6a04afe-4fd0-4be3-94b7-1e189f04c426 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1280 microversion: 2.20 time: 0.319253 Oct 21 15:04:35.195402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 27/46] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:34 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:35.590987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6592a965-28d8-43a6-8ba7-a071aa04cd3b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:35.603720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6592a965-28d8-43a6-8ba7-a071aa04cd3b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1240 microversion: 2.1 time: 0.518520 Oct 21 15:04:35.654030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 20/47] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:35 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1240 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:35.871800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:35.873776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:35.893726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:35.897960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:35.913404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:35.915495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:35.918040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:35.925865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:35.995088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:35.995088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:36.009633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.012195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.018143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:36.018143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.018143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.019349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:36.801161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:36.810496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fa71caf1-083d-42a4-8e60-41df71099225 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.825242 Oct 21 15:04:36.811448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 21/48] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:35 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:36.830615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:36.831274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:36.852865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:36.863233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-933fad94-281c-4282-acef-f2a3071ae357 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.999707 Oct 21 15:04:36.865309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.865834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.866253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:36.868707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.870890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 28/49] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:35 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:36.873213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.875414 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:36.879365 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:36.889279 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:36.917234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.922561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.926618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:36.940305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:36.941319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:36.941775 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:37.161767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:37.173882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:37.175785 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:37.177173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-60a0a876-bb45-471d-913c-05f43ffbd757 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1332 microversion: 2.20 time: 0.364568 Oct 21 15:04:37.177910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 22/50] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:36 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1332 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:37.269347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:37.301646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8162bf4c-d0ca-4dff-a212-c270efb572a2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1236 microversion: 2.1 time: 0.423354 Oct 21 15:04:37.309875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 29/51] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:36 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1236 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:37.423039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b7c473fa-b4dc-40d2-88df-43e42ee87af6 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e11f80d0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:37.626864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b7c473fa-b4dc-40d2-88df-43e42ee87af6 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c858b747-714a-44eb-a6fb-7a069e550249" status: 200 len: 351 microversion: 2.1 time: 0.207662 Oct 21 15:04:37.627838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 23/52] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:37 2022] GET /compute/v2.1/os-volumes/c858b747-714a-44eb-a6fb-7a069e550249 => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:37.840317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:37.841243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:37.866196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:37.868654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:37.870296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:37.873132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:37.879506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:37.880336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:37.892595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:37.897255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:37.911850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:37.917592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:37.917592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:37.928992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:37.929625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:37.937868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:39.070161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.084095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-450ea3e2-457b-44c0-acfd-65855b3cb130 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 1.195877 Oct 21 15:04:39.094979 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 24/53] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:37 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:39.097968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:39.098908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:39.118469 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:39.118988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:39.119596 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:39.121742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:39.122370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:39.122983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:39.216851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.241293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-84a8285a-78f8-4b56-8dd2-2ff55c43b941 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 1.408715 Oct 21 15:04:39.244109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 30/54] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:37 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:39.251705 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:39.253127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:39.264010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:39.290346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:39.290346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:39.290346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:39.290346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:39.290846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:39.470851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.483180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.485192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.486708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e9907779-2cbc-4194-8b55-dbec52504353 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1338 microversion: 2.20 time: 0.398683 Oct 21 15:04:39.487517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 25/55] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:39 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1338 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:39.639857 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:39.652959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0ea68f52-dc8d-4422-bd8d-ab7a0dc052e9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1292 microversion: 2.1 time: 0.406091 Oct 21 15:04:39.687744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 31/56] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:39 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1292 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:39.864210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-49a8625c-2d75-4c5f-853c-b766d4ab0b1c tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1159d30>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:39.993434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-49a8625c-2d75-4c5f-853c-b766d4ab0b1c tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d8e20c2f-43a0-4927-b4cb-8ffcfc9dd109" status: 200 len: 351 microversion: 2.1 time: 0.133150 Oct 21 15:04:39.994602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 32/57] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:04:39 2022] GET /compute/v2.1/os-volumes/d8e20c2f-43a0-4927-b4cb-8ffcfc9dd109 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:40.015243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a10fd821-0dc6-4d69-b2c2-c77e5ec75616 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1179dc0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:40.120745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d3f579-4139-41ae-a20b-b25f1c6b95a7", "tag": "f027ca64-6e10-42a3-a356-857ce1a446a0"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:40.162797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.163292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.163732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.262765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a10fd821-0dc6-4d69-b2c2-c77e5ec75616 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.252283 Oct 21 15:04:40.263661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Oct 21 15:04:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:40.268818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Creating event network-changed:f027ca64-6e10-42a3-a356-857ce1a446a0 for instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 on hv-cinder-83608 Oct 21 15:04:40.269861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 21 15:04:40.277383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:40.278441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:40.279205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9c823a25-1dee-4e45-a356-72dfc01a637f req-b9434aa9-0925-421c-ae47-85346872f63c service nova] Acquired lock "compute-rpcapi-router" {{(pid=119357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 21 15:04:40.283729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.284566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.285947 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.288436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.291461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.292117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.310243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.313497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.313497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.313497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.313497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.314091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.347019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.compute.rpcapi [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 21 15:04:40.357711 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] Releasing lock "compute-rpcapi-router" {{(pid=119357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 21 15:04:40.411380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-672a8689-9138-4df4-a893-b16e8e79d75d None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.562006 Oct 21 15:04:40.414347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 26/59] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:40.422318 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:40.423272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:40.432065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.433280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.434113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.435087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.435675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.436743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.830758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:40.864741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:40.873544 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-98e3b227-2709-4dc3-bd7e-e2a9ae4efd1b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.457601 Oct 21 15:04:40.879614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 27/60] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:40 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:40.887229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ec62d077-fb25-43f4-a183-dd02f169d63f tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e11d9550>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:40.892904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5558da1e-2fd1-49e0-971e-d9ab5165a325 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.620235 Oct 21 15:04:40.894357 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 34/61] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:40 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:40.944992 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:40.946924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:40.990674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:40.994140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:40.996479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:40.998517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:41.001090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:41.001877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:41.057231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ec62d077-fb25-43f4-a183-dd02f169d63f tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.176094 Oct 21 15:04:41.058162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 28/62] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Oct 21 15:04:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:41.063126 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:41.063925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:41.083009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:41.083514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:41.083999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:41.084719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:41.085184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:41.085616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:41.156570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:41.183278 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:41.186577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:41.188263 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-79919e24-564b-464c-8933-3e33e777b335 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1338 microversion: 2.20 time: 0.266158 Oct 21 15:04:41.189546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 35/63] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:40 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:41.198951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b0445278-dad1-4f6c-b4c8-59d8ef92d85a tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e11664c0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:41.283206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:41.302381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eae2d81c-2f61-41c6-b464-ea132259a098 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1298 microversion: 2.1 time: 0.240239 Oct 21 15:04:41.324446 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 29/64] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1298 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:41.364409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b0445278-dad1-4f6c-b4c8-59d8ef92d85a tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.172688 Oct 21 15:04:41.366081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 36/65] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:41.379648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-154c66ab-a89a-428d-a710-77462556ea38 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1126820>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:41.538738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-154c66ab-a89a-428d-a710-77462556ea38 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161171 Oct 21 15:04:41.543367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 37/66] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:41.557668 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2f825bdd-151a-45f4-a73a-1d082c1a9580 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e112b0d0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:41.809488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2f825bdd-151a-45f4-a73a-1d082c1a9580 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.257684 Oct 21 15:04:41.810432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 38/67] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:41.828348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-870f06d3-5f11-449a-9124-f74c68145a48 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1126af0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:41.870563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd539fde-6a8b-427a-aea0-fa13d89a7d65", "tag": "85f359e2-b00b-4baa-a54e-0be68cf11c36"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:41.886625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:41.897721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:41.903656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:41.944215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] Creating event network-changed:85f359e2-b00b-4baa-a54e-0be68cf11c36 for instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 on hv-cinder-83608 Oct 21 15:04:41.971978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-622dbccc-7ae9-4f95-9937-52c63c321688 req-80bf04fe-4355-435f-9945-b563c07bb0a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.643300 Oct 21 15:04:41.972612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 30/68] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:42.000459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:42.001185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:42.004359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-870f06d3-5f11-449a-9124-f74c68145a48 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.179047 Oct 21 15:04:42.004359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 39/69] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:42.011513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:42.012430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:42.020416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.022388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.023167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.024271 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.025025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.025833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.036936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.037342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.037775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.038498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.048562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.049039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.496540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:42.505202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-59a053e7-ef18-4743-b186-acc75527b3d7 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.500971 Oct 21 15:04:42.506482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 40/70] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:42 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:42.524440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-46fe7783-28e1-4bc6-ab77-e72d84cbb0e1 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1179f70>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:42.545276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:42.556611 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5faed722-af78-4e8b-a145-910f06fabbf9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.570505 Oct 21 15:04:42.563398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 31/71] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:41 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:42.574298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:42.582026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:42.595838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.596329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.596760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.601111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.601111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.601111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.708624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-46fe7783-28e1-4bc6-ab77-e72d84cbb0e1 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.200677 Oct 21 15:04:42.710182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 41/72] 10.222.0.60 () {58 vars in 1188 bytes} [Fri Oct 21 15:04:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:42.717016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:42.718006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:42.731321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.732889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.733984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.735560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:42.736469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:42.740482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:42.970874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:42.988005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a623a774-10ec-45d3-8ceb-aa25d4bd8ffe tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1298 microversion: 2.1 time: 0.276438 Oct 21 15:04:42.993016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 42/73] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:42 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:43.002222 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0d8300e5-d9cb-4288-b4d3-d8f9ae1e95d0 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] Calling method '.version_select at 0x7fd1e1126700>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:43.006688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:43.032079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:43.036834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:43.039422 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7054fbf9-b9a9-43cc-b1f3-1730018b5c9e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1338 microversion: 2.20 time: 0.474036 Oct 21 15:04:43.040619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 32/74] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:42 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1338 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:43.235589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0d8300e5-d9cb-4288-b4d3-d8f9ae1e95d0 tempest-VolumesTestJSON-593834883 tempest-VolumesTestJSON-593834883-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.241569 Oct 21 15:04:43.237233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 43/75] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Oct 21 15:04:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:43.532368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:43.533734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:43.555635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:43.558340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:43.562698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:43.567690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:43.568292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:43.571049 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:43.590163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:43.590777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:43.612802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:43.615373 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:43.618499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:43.620903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:43.625361 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:43.626678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:43.846747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:43.866965 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1f2943a6-92c7-4a92-99d1-cea9b9c91aa0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.341045 Oct 21 15:04:43.868300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 33/76] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:43 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:43.992562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:44.006154 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d205cae4-67fb-479a-9677-4ebd386ba06b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.421020 Oct 21 15:04:44.006865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 44/77] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:43 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:44.020625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:44.022460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:44.035425 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:44.036888 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.038140 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.039577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.045374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.046169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.046880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.074604 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:44.075639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:44.077974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=4 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:44.097642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.098375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.099957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.101178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.101996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.102996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.220943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:44.235613 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a03aa4a3-061c-4604-88e8-4253c1e8d37b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1298 microversion: 2.1 time: 0.223957 Oct 21 15:04:44.240209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 34/78] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:44 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:44.265616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4298bf2-1299-4552-9929-5128607d4daf", "tag": "2ec9c9f0-770b-45e7-9198-e7df0236240f"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:44.277066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.280089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.280776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.300854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] Creating event network-changed:2ec9c9f0-770b-45e7-9198-e7df0236240f for instance c4298bf2-1299-4552-9929-5128607d4daf on hv-cinder-83608 Oct 21 15:04:44.307355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-e87cd4e1-6b2b-4c6f-91a6-bcee3c4ea3b3 req-11ef08df-c6ef-4955-ac23-cb7894574f42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065525 Oct 21 15:04:44.308803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 35/79] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:44.458609 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:44.470612 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:44.472273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:44.473387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b48e70de-5709-4f15-8baf-4f6d9b65ad31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.403042 Oct 21 15:04:44.473939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 45/80] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:44 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:44.894683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:44.897117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:44.916386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.922590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.923530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:44.924327 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:44.927805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:44.931496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.033960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:45.036192 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:45.051054 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.054017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.056011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.058456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.059007 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.059442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.187149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=22 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:45.310541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:45.332639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cc5030bc-a27c-40ef-aef5-86bb45727c6e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.431968 Oct 21 15:04:45.332639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 36/81] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:44 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:45.344641 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:45.346421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:45.360996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.361663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.362110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.371688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.372224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.372833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.601274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=30 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:45.715803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:45.741518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-593b9581-1f7d-4027-9c55-15a13d80c3ac tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.711632 Oct 21 15:04:45.766503 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 46/82] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:45 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:45.779370 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:45.780428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:45.793391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.793935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.794462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.795214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:45.795777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:45.796224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:45.813444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:45.830473 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e94b9a66-60b5-4154-9be2-43804c8c0236 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.507069 Oct 21 15:04:45.843804 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 37/83] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:45 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:46.107932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:46.113651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:46.132763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:46.154212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:46.168500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-703d70c0-1ae1-4c61-896f-529000805653 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.397630 Oct 21 15:04:46.173685 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 47/84] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:45 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:46.359584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:46.361026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:46.381548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.382045 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.390519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.390519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.390519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.390519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.746831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:46.758158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-888765e5-01ca-458c-99d8-5a6cf659453b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.404920 Oct 21 15:04:46.758803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 38/85] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:46 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:46.848381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:46.848381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:46.848381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.848381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.849600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.849600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.849600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.849600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.862451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:46.863117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:46.884394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.885160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.886173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.886806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:46.887474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:46.888048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:46.893638 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:47.139806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:47.145501 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:47.154608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-abe0a8f4-03b4-4992-a479-77c4ad15d315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.298782 Oct 21 15:04:47.155316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 39/86] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:46 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:47.155986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cec23902-a86c-478b-b5a1-743d645643a7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.389910 Oct 21 15:04:47.170702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 48/87] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:46 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:47.205159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:47.205775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:47.216807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.221178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.221178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.221178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.221178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.221623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.357385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:47.365457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:47.366918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:47.368010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-288d9be6-87f8-4d76-aa9e-7a4e28566201 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.167004 Oct 21 15:04:47.368552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 40/88] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:47 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:47.408840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:47.421739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.422301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.422993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.455665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Creating event network-changed:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:04:47.456852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 21 15:04:47.457333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1aac9c20-8f01-459d-900d-2d893586bf01 req-7ac62873-8005-420d-baf0-7f1ef6f7cd90 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 21 15:04:47.458451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.459538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.460096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.461078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.461633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.462289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.487713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.compute.rpcapi [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 21 15:04:47.488707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] Releasing lock "compute-rpcapi-router" {{(pid=119358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 21 15:04:47.513918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e7f592f1-b40d-4d78-b2ff-3d968389e3e2 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110445 Oct 21 15:04:47.514831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 49/89] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:47.787789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:47.788402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:47.795497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.795975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.796406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:47.797099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:47.797554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:47.798035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.002110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.015985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ce62ff33-f7bb-4e86-b9fe-a6b4a093ada6 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.232039 Oct 21 15:04:48.020577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 41/90] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:47 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:48.180354 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:48.181000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:48.181683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:48.183270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:48.184659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:48.188586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.189079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.189541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.190248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.190755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.191353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.191481 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.191838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.192317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.193468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.193926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.194507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.478267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.486058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-462901ea-cecb-469e-9f1d-27576a9c3596 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.312114 Oct 21 15:04:48.499607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 50/91] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:48 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:48.507754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:48.511052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:48.515182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.515671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.516287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.517141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:48.517737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:48.518335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:48.530821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.543251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0d0e9abd-0783-4eb9-b70a-b027432ebc1c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.364113 Oct 21 15:04:48.545527 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 42/92] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:48 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:48.715448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.725609 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.727458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:48.729927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-59af2ea7-2121-4f28-8b1b-65427163476d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.229133 Oct 21 15:04:48.746448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 51/93] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:48 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:49.040119 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:49.040621 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:49.047307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.047789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.048232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.048919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.049373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.049883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.228071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.237652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4b7b11d4-aa8c-4eef-bad0-2ab4bfd0de46 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.201874 Oct 21 15:04:49.238313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 43/94] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:49 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:49.513693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:49.514299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:49.525314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.526788 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.527093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.527880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.528540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.528963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.530851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53221d88-6f22-49de-9589-94759df68635", "tag": "8b960579-3161-44a9-932e-f96e86acfcad"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:49.541706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.542484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.543159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.559358 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] Creating event network-changed:8b960579-3161-44a9-932e-f96e86acfcad for instance 53221d88-6f22-49de-9589-94759df68635 on hv-cinder-83608 Oct 21 15:04:49.565255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-86d32f69-c46a-4e56-97b8-2c50e5415d5b req-cfe95163-a495-464d-8170-bdb4af9eb3b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039024 Oct 21 15:04:49.566427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 44/95] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:04:49.577536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:49.578511 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:49.585071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.585561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.586187 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.587101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.587719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.588987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.738853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.749613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7ad0c44e-6564-46ca-9ca9-3eb08219381b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.240393 Oct 21 15:04:49.763080 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 52/96] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:49 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:49.771539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:49.771805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.772602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:49.779791 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.780276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.780883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.781005 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3901ce63-a4d9-4d60-a86c-cab9b951507d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.212992 Oct 21 15:04:49.781541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 45/97] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:49 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:49.781703 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:49.782160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:49.782577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:49.929758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.939059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.940807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:49.942393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-57975faa-e381-46d9-b421-4e20eab0c156 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.178289 Oct 21 15:04:49.943051 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 53/98] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:49 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:50.261041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:50.261731 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:50.267705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.268191 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.268626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:50.269316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.269775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.270199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:50.318480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=8 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:50.420747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:50.429025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a51b9bc9-8467-482e-94e6-56fbb03807d1 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.171970 Oct 21 15:04:50.429957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 46/99] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:50 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:50.778690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:50.779485 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:50.786085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.786554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.787327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:50.788273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.788727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.789409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:50.804240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:50.805586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:50.814405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.815303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.816104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:50.817028 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:50.818335 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:50.818995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:51.022760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.024604 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.031529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c0b8ef9d-e49d-4d24-8654-a2bdeaa52ec1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.258292 Oct 21 15:04:51.042799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 54/100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:50 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:51.042948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2a1ed6d1-512a-4b09-a21f-3ac786574db0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.232964 Oct 21 15:04:51.042948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 47/101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:50 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:51.043082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:51.043082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:51.047342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:51.047342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:51.047342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:51.047342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:51.047580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:51.047580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:51.200068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.209190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.210994 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.212223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-58195c4e-42db-43a7-ab4f-959819460536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.178642 Oct 21 15:04:51.213063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 55/102] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:51 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:51.460108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:51.461079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:51.470771 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:51.477383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:51.477383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:51.477383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:51.477383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:51.477885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:51.614820 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:51.623206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-02e5e13a-b29f-4e85-a03f-7e8c6a9ca434 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.173621 Oct 21 15:04:51.623811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 48/103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:51 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:52.061675 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:52.062291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:52.065300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:52.065943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:52.071780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.072035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.072276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.072624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.072745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.073284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.073556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.074023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.074137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.074454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.074578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.075003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.282975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.286355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.291261 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fc14e0d6-4d90-4d6f-910f-8468ca926a78 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.234814 Oct 21 15:04:52.293113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 49/104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:52 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:52.295680 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-87519c47-2809-4bab-b243-7e7c172a52da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.242798 Oct 21 15:04:52.310691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:52.310691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:52.310974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 56/105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:52 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:52.311060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.311060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.311060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.311060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.311309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.311309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.452521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.460768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.462186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.464532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4d313989-1fc4-4954-9ca4-0ebedf81b44d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.169322 Oct 21 15:04:52.465127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 50/106] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:52 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:52.646530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:52.647164 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:52.653832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.654307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.654773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.655451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:52.655897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:52.656311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:52.796087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:52.804856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a68a5f5c-d7a4-4aea-a1ec-5a95b921323e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.162095 Oct 21 15:04:52.805548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 57/107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:52 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:53.320330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:53.320936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:53.321346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:53.321552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:53.327963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.328441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.328874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.329077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.329579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.329878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.330050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.330415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.330737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.331586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.332172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.332923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.537763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:53.543911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:53.547244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9add7cba-2adf-4db3-9e03-da3326080fcc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.230189 Oct 21 15:04:53.548335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 58/108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:53 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:53.554075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:53.554806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:53.558082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7c5b9529-cc0a-4696-9f12-25009a78f02f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.241228 Oct 21 15:04:53.559240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 51/109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:53 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:53.573819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.574312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.574844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.575616 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.576130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.576636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.736911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:53.747198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:53.748972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:53.750505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-249572d8-3e6b-4571-9581-f55c41baaf0d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.200837 Oct 21 15:04:53.751199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 59/110] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:53 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:53.833708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:53.833708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:53.836696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.836956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.837384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:53.838111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:53.839215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:53.839640 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.019574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.028399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eff22f81-faa3-463c-bdb9-8484e0c784a3 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.202742 Oct 21 15:04:54.028973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 52/111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:53 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:54.571026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:54.571636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:54.580455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.580949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.581385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.582086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.582540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.583173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.584901 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:54.585513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:54.591693 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.592273 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.592704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.593397 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.593849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.594269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.796687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.800299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.807316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4ae3c5c8-e22f-4c64-b8b8-16d7cffb10ff tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.239961 Oct 21 15:04:54.808183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 60/112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:54 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:54.814449 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:54.815170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:54.821581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.822067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.823423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.824319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:54.824956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:54.825674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-da56be2c-3f9c-4097-83c0-9db1d58c2ca5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.244904 Oct 21 15:04:54.825834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:54.826820 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 53/113] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:54 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:54.965601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.972370 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.973819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:54.974953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a772956e-016b-4279-b7f0-5d07f3d1517e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.165417 Oct 21 15:04:54.978658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 61/114] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:54 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:55.051589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:55.052209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:55.059151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.059636 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.060076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:55.062945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.062945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.062945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:55.193555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:55.202242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-747554b3-1fe4-4eca-9cc8-b917df89ae52 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.154529 Oct 21 15:04:55.203090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 54/115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:55 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:55.832800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:55.833910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:55.840841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.841321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.841748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:55.842439 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.843127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.843557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:55.849056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:55.850371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:55.857822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.858385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.858970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:55.859747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:55.860449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:55.860876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:56.051382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.059331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c34396d0-f0ef-4a71-ba59-91b3fa8a6e68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.230280 Oct 21 15:04:56.060004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 62/116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:55 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:56.068228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.069490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:56.070186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:56.076876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:56.077360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:56.077615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-206fe906-c1e3-4200-96c8-fee848047d4e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.232361 Oct 21 15:04:56.077796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:56.078192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 55/117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:55 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:56.078490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:56.078972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:56.079395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:56.211298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.221272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.222785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.223906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-17131da4-c41f-4efe-b6d6-872419d96f4d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.158643 Oct 21 15:04:56.224461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 63/118] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:56 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:56.226177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:56.226818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:56.233162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:56.233650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:56.234081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:56.234874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:56.235240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:56.235660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:56.259715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:56.375989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:56.383930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-059061a8-101c-4d8f-b630-24a53db1f704 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.162230 Oct 21 15:04:56.389227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 56/119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:56 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:57.082578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:57.083223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:57.090337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.091110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.091549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.092271 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.092719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.093136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.104169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:57.105738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:57.113333 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.114183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.114846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.115796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.116406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.117028 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.316264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.320439 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:57.326869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c9231cab-a37c-48fa-b360-bfbedac9330f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.247804 Oct 21 15:04:57.327997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 64/120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:57 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:57.332982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:57.337408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:57.344477 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.345249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.345862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.346887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.347488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.348059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.360942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.373628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f60050ab-d1e5-4cfc-b465-21cb050c84ea tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.275082 Oct 21 15:04:57.374163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 57/121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:57 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:57.412190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:57.412802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:57.422495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.426339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.426816 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.427534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.427996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.436938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.484637 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:04:57.607483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.616642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.618238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.619480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5cf9d324-0ba1-4b4a-ac8b-7af0523077ce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.290011 Oct 21 15:04:57.620209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 65/122] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:57 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:57.631405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:57.643444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fc88935f-038a-4f02-bb18-77a7f0f339a0 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.235771 Oct 21 15:04:57.646154 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 58/123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:57 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:57.704350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3f579-4139-41ae-a20b-b25f1c6b95a7", "name": "network-vif-plugged", "status": "completed", "tag": "f027ca64-6e10-42a3-a356-857ce1a446a0"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:04:57.730104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:57.730589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:57.731083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:57.742817 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] Creating event network-vif-plugged:f027ca64-6e10-42a3-a356-857ce1a446a0 for instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 on hv-cinder-83608 Oct 21 15:04:57.747858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-5004260f-f8f3-4e8a-b46a-068499a8ce06 req-4076690c-b9ea-4b59-81bf-b88c80216329 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115896 Oct 21 15:04:57.748440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 66/124] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:04:58.354742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:58.356036 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:58.362286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.362992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.363421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.364112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.364555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.365113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.399887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:58.400581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:58.407507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.407998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.408421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.409147 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.409594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.410006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.559043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.566851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2da203e8-89e6-4611-bd6f-23c6a01910ed tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.217289 Oct 21 15:04:58.568042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 59/125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:58 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:58.585544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.593937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d0a5c3ba-227d-4976-ba2a-9b429515ba9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.198047 Oct 21 15:04:58.594368 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 67/126] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:58 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:58.644287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:58.644896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:58.651027 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.651579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.652021 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.652704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.653156 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.657228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.668300 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:58.669076 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:58.675578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.676269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.676705 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.680411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:58.680411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:58.680411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:58.863281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.867419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.872895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-db0349dd-2a0d-4e2a-9dc8-10f62ab53a74 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.209587 Oct 21 15:04:58.873534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:58 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:04:58.887310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.887310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:58.887310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c8243505-980e-44b8-857d-b0a3ac7c43c5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.239816 Oct 21 15:04:58.887928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 60/128] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:58 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:04:59.590779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:59.591370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:59.597474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:59.597991 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:59.598419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:59.599121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:59.599573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:59.599987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:59.617237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:59.617848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:04:59.624552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:59.625038 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:59.625483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:59.626176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:04:59.626687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:04:59.627122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:04:59.969438 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:59.978527 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-777ec0fd-368d-4079-b2e2-5b871eeaf918 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.391659 Oct 21 15:04:59.989075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 61/129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:59 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:04:59.989752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:04:59.989846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:04:59.989846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:00.000026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:00.000026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:00.000026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:00.000026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:00.000433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f21552a5-e179-49ba-b987-1cf2381ba464 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.379527 Oct 21 15:05:00.000517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:00.000587 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 69/130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:59 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:00.000652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:00.000716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:00.000716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:00.006137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:00.006624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:00.007093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:00.007781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:00.008234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:00.008655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:00.196725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:00.204058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:00.208857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-40f3d932-75a8-4820-a5bd-a5e45f9fed84 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.227883 Oct 21 15:05:00.209652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 62/131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:04:59 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:00.234236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:00.234236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:00.234236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8f9b67c9-d879-4284-a2f0-0f0ececafcab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.222922 Oct 21 15:05:00.234504 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 70/132] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:04:59 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:01.002049 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:01.002671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:01.008751 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.009225 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.009719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.010338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.010811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.012082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.019610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:01.023734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:01.027053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.027953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.028454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.029665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.030192 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.030712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.237656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.246909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-59bde14d-391f-43f4-bd63-f7c9e716dac8 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.248735 Oct 21 15:05:01.249801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 63/133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:00 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:01.254476 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:01.255183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:01.261684 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.262168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.262823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.263758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.275240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.280591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.281116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.289535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3fb53f8d-9061-4071-95de-6cd73a6523b0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.272152 Oct 21 15:05:01.301937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 71/134] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:01 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:01.315873 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:01.316808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:01.325678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.326487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.327428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.329159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:01.329681 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:01.330206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:01.500491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.508682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-897d39aa-6f62-4378-a192-c07eb09142f5 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.257776 Oct 21 15:05:01.523433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 64/135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:01 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:01.546041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.555801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.557360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:01.559245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-52f2c711-dd32-4768-a5b5-2b8fa211764d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.256253 Oct 21 15:05:01.559827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 72/136] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:01 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:02.272949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:02.273576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:02.280893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.281462 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.281970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.283012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.283729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.284307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.323083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:02.325281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:02.332354 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.337163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.337163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.337163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.337163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.337596 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.480607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.490064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-72d86b6b-d0e8-4920-9e57-4745fd666a08 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.220933 Oct 21 15:05:02.490869 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 65/137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:02 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:02.514819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd539fde-6a8b-427a-aea0-fa13d89a7d65", "name": "network-vif-plugged", "status": "completed", "tag": "85f359e2-b00b-4baa-a54e-0be68cf11c36"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:02.528362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.533248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.535532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.535532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.545777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a8762edb-edbe-472c-9049-a16f286ff499 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.226441 Oct 21 15:05:02.546542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 73/138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:02 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:02.549795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] Creating event network-vif-plugged:85f359e2-b00b-4baa-a54e-0be68cf11c36 for instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 on hv-cinder-83608 Oct 21 15:05:02.554887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-6eecbf15-b9ac-46c1-a050-aa5a6c13d1d8 req-4703f8e0-b045-4e18-a7fe-df3b65543dd4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045143 Oct 21 15:05:02.555684 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 66/139] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:05:02.558738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:02.559344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:02.569295 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.570042 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.570516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.571307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.571835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.572244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.584600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:02.585657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:02.593866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.594552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.595228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.596384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:02.596908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:02.597439 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:02.828458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.842344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5fd0905a-93f8-4c7b-88a4-f3f5b6db5981 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.287783 Oct 21 15:05:02.843896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 74/140] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:02 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:02.895924 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.905633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.907730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:02.908868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ac98b7cd-9fff-4a23-b350-d6a0cd2bcb5b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.328449 Oct 21 15:05:02.909736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 67/141] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:02 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:03.522497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:03.523128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:03.530171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.530660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.531092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.531771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.532215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.532625 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.572860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:03.573998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:03.587402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.587887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.588317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.589000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.591344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.591907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.751307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:03.759638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-da321570-cb83-4a6e-8c44-b7f0bcb6e82a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.240890 Oct 21 15:05:03.760226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 75/142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:03 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:03.791607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:03.799539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e9939ae9-2873-4989-a516-972bdd93cc6e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.231019 Oct 21 15:05:03.800113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 68/143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:03 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:03.867721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:03.868336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:03.874897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.875389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.875824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.876517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.876973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.877389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.935837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:03.936573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:03.942585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.943103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.943538 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:03.944232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:03.944861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:03.945288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.156944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:04.179231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d839c349-2a33-4589-bbd5-09862519cf5b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.313808 Oct 21 15:05:04.184873 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 76/144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:03 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:04.185052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:04.203485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:04.205107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:04.206399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ad98f0e8-b256-4097-9491-6f0e5c11d350 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.275431 Oct 21 15:05:04.207474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 69/145] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:03 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:05:04.574403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4298bf2-1299-4552-9929-5128607d4daf", "name": "network-vif-plugged", "status": "completed", "tag": "2ec9c9f0-770b-45e7-9198-e7df0236240f"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:04.584771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:04.585404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:04.585840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.598357 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] Creating event network-vif-plugged:2ec9c9f0-770b-45e7-9198-e7df0236240f for instance c4298bf2-1299-4552-9929-5128607d4daf on hv-cinder-83608 Oct 21 15:05:04.603456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-31a3e26a-1702-47a4-a6fc-e85d7636ebd6 req-d0718b2f-3056-4fb2-abd7-264f5da4d3ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Oct 21 15:05:04.604293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 77/146] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:04.785224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:04.785828 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:04.792191 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:04.794166 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:04.794600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.795423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:04.795789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:04.796188 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.823790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:04.824672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:04.840731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:04.842282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:04.842862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.845542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:04.847168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:04.848148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:04.990607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:04.999797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8de235f5-2e00-4689-a537-f66ea80aa052 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.218373 Oct 21 15:05:05.003597 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 70/147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:04 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:05.072022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:05.099918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4787a191-efec-48ec-8991-627340735af7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.280419 Oct 21 15:05:05.102979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 78/148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:04 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:05.203569 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:05.204177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:05.210180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:05.210683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:05.211114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:05.211790 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:05.212232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:05.212647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:05.236110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:05.236741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:05.247955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:05.248447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:05.248877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:05.252685 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:05.253222 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:05.253626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:05.485153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:05.487198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:05.493967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:05.496458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:05.500601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f27c4d63-7bfa-4b2d-b352-b053b72077e4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.266103 Oct 21 15:05:05.500601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 79/149] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:05 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:05.513319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-de16cd20-84a5-4f00-ba76-6960f158a29d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.314337 Oct 21 15:05:05.513914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 71/150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:05 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:06.026001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:06.027790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:06.033410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.033892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.034333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.035045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.035489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.035921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.129654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:06.130262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:06.137174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.137363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.137792 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.138483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.138963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.139384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.171117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.184069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f19125c3-1a5c-485a-a432-e9ef37fda88b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.162477 Oct 21 15:05:06.184562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 80/151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:06 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:06.272562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.281951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bae2b778-982c-46e5-8d83-5742da5022d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.155994 Oct 21 15:05:06.283821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 72/152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:06 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:06.525232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:06.526172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:06.536317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.536968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:06.537389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.537584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:06.538149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.539082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.539990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.540614 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.547647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.548127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.548560 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.549251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:06.549701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:06.550136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:06.790394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.796974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:06.810092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d20443f6-0ff7-43f2-87a0-37ba244bc3c8 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1315 microversion: 2.1 time: 0.276613 Oct 21 15:05:06.820914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.830014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 73/153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:06 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:06.830736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.832183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:06.833306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-66dd9300-52c7-4323-90b6-0238e80e6ee2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.312677 Oct 21 15:05:06.834243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 81/154] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:06 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:07.207576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:07.208704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:07.229364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.230444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.230904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.235593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.236015 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.236450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.305416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:07.306021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:07.312225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.312707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.313135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.313827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.314282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.314722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.407911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:07.415807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7de4d815-7476-40db-93be-009852dc505b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.212224 Oct 21 15:05:07.416373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 74/155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:07 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:07.473546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:07.477182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:07.483306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-87a8b68f-d5df-443f-839c-31f68e382550 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1321 microversion: 2.1 time: 0.181747 Oct 21 15:05:07.483905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 82/156] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:07 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:07.833399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:07.834018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:07.840532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.841016 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.841454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.842185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.842602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.845945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.859893 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:07.860566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:07.866699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.867187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.867622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:07.868430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:07.868883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:07.869371 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.057372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.061594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.065373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2a39d8ec-d8db-4321-a6d0-f6102c5d3222 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1502 microversion: 2.1 time: 0.236011 Oct 21 15:05:08.065946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 75/157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:07 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:08.069738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.071232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.072323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a3782df0-5e7d-45ea-9fd0-d1599bf1352f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.217614 Oct 21 15:05:08.072862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 83/158] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:07 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:05:08.439120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:08.440396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:08.447117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.447600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.448229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.449953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.450589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.451179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.509240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:08.509928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:08.516933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.517431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.517880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.518999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.519463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.519940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.656695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.664930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6be66db6-f220-4040-95b2-5bfedb1bd6de tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.229627 Oct 21 15:05:08.665494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 76/159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:08 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:08.685669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:08.693442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f068288b-e1f1-4d5e-bcb6-2c2fdb20ac18 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1515 microversion: 2.1 time: 0.188036 Oct 21 15:05:08.694116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 84/160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:08 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:08.718563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:08.720891 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:08.727116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.727742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.728297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.729088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:08.729554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:08.731783 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:08.799941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'flavor' on Instance uuid c4298bf2-1299-4552-9929-5128607d4daf {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:05:09.097468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:09.101431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:09.104153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.105105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.106169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.106892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.107347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.107765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.273368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-728e50a7-6527-4ec1-864a-12e5a7c67f19 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf/action" status: 200 len: 32 microversion: 2.1 time: 0.559507 Oct 21 15:05:09.281934 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 77/161] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:05:08 2022] POST /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf/action => generated 32 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:05:09.286278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:09.287130 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:09.294157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.294785 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.295387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.296174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.296756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.297269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.319979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:09.329046 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:09.330508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:09.331727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-960ff316-5efb-4408-9a14-c7cd2d85b61e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.238156 Oct 21 15:05:09.333460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 85/162] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:09 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:05:09.491441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:09.500108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a6b32bc5-675a-48bf-9726-eb186bb745ab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.218413 Oct 21 15:05:09.501036 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 78/163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:09 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:09.688323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:09.689071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:09.695144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.695624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.696055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.696738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:09.697189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:09.697607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:09.856191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:09.863849 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d7ebbebe-d456-413e-9756-b53434c0c392 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.179384 Oct 21 15:05:09.864427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 86/164] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:09 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:10.356656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:10.357588 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:10.376849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.381002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.381864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:10.382952 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.384252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.385015 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:10.525095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:10.525742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:10.536936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.537437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.537874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:10.538571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.539058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.539733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:10.546943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:10.575352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:10.577076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:10.581083 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-48bdd797-e2cb-4947-924b-2301e7bea393 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.225562 Oct 21 15:05:10.591036 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 79/165] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:10 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:10.692239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:10.700783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-40804722-5a31-4408-98ba-cea8f94d1b61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.180331 Oct 21 15:05:10.701510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:10 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:10.888379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:10.888979 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:10.894796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.895251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.895682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:10.896362 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:10.896809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:10.897226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.041938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:11.051659 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-140822b3-bf06-4958-bce8-21cccf23e63e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.168136 Oct 21 15:05:11.052433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 80/167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:10 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:11.055579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0dbec45-0aca-4c11-87e4-0bac54d1af88"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:11.059319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:11.068506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.069145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.069694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.070489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.071066 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.071850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.521563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53221d88-6f22-49de-9589-94759df68635", "name": "network-vif-plugged", "status": "completed", "tag": "8b960579-3161-44a9-932e-f96e86acfcad"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:11.547330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.547985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.548490 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.581419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] Creating event network-vif-plugged:8b960579-3161-44a9-932e-f96e86acfcad for instance 53221d88-6f22-49de-9589-94759df68635 on hv-cinder-83608 Oct 21 15:05:11.587214 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-091f27d0-a56c-44d6-8dc8-96799bf76282 req-3d2cf21a-9856-4a4b-9846-71989e1e865b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069705 Oct 21 15:05:11.588366 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 81/168] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:11.626311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:11.627050 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:11.642784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.643270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.643697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.644623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.645247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.647087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.827639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:11.838873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:11.841393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:11.842802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dfebec37-22dd-4b86-b6ed-809f54429b34 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.224611 Oct 21 15:05:11.843565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 82/169] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:11 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:11.865236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:11.865854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:11.872624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.873120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.873554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:11.874250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:11.874732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:11.875154 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:12.035703 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:12.044206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-224c32e1-7400-462b-87c4-a3891b7fd107 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.184258 Oct 21 15:05:12.044795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 83/170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:11 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:12.076114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:12.076726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:12.080057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:12.083470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:12.083955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:12.084382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:12.085072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:12.085520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:12.085938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:12.241533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:12.250339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dfbdb09f-cda8-4eeb-95de-14338d79b61e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.178666 Oct 21 15:05:12.250984 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 84/171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:12 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:12.432369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d4bdf26e-37d6-4f16-a39b-3b1765fc4001 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "POST /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.381103 Oct 21 15:05:12.434066 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 88/172] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:05:11 2022] POST /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65/os-volume_attachments => generated 194 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:12.876362 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:12.877078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:12.885524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:12.886596 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:12.887364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:12.888379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:12.889003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:12.889911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.040355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:13.049700 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:13.051507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:13.052600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4a812185-108f-48d7-b020-96d430f53427 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.182508 Oct 21 15:05:13.053148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 85/173] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:12 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:13.074927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:13.074927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:13.077738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:13.078223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:13.078746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.079610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:13.080060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:13.080479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.220638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:13.228625 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2c9a3036-9e07-43b0-9092-9cca1e7bfb9a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.163785 Oct 21 15:05:13.229272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 89/174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:13 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:13.273203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:13.273913 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:13.280787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:13.281268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:13.281698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.282387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:13.282867 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:13.283285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.414834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:13.423093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-219ffc50-1f88-490f-b1ec-a46a732c1503 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.153574 Oct 21 15:05:13.434808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 86/175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:13 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:13.619379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "name": "network-vif-plugged", "status": "completed", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:13.629716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:13.630197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:13.630624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:13.642580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] Creating event network-vif-plugged:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:05:13.647978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-50a435f3-7b5d-45fc-894b-b9410d133247 req-cbe86723-58ff-49e9-845a-422fa20fa8cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Oct 21 15:05:13.648589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 90/176] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:14.092926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:14.092926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:14.096914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.097402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.097835 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.098703 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.099352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.099777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.232814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:14.241371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:14.242870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:14.243968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-67c6543b-15fa-4905-a2d1-9b164f87de4c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.162845 Oct 21 15:05:14.244652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 87/177] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:14 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:14.253350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:14.254054 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:14.260308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.260899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.261445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.262142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.266430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.266430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.397330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:14.406137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5a004b87-e512-4b36-a473-38808d90ce43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.156875 Oct 21 15:05:14.406831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 91/178] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:14 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:14.447095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:14.447705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:14.453952 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.454440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.456406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.457121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:14.457587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:14.458042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:14.587474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:14.596784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-42587557-d488-464e-be8b-028ea22bc9df tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1366 microversion: 2.1 time: 0.153444 Oct 21 15:05:14.597381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 88/179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:14 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:15.270198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:15.271009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:15.278022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.278667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.279163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.279966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.280486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.280976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.423587 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:15.429377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:15.430026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:15.434966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:15.436430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:15.437282 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.437761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e7cf9107-6c81-4232-86e7-a5bac89b4849 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.171536 Oct 21 15:05:15.437885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.438200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.450729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.450917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 92/180] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:15 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:15.450999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.450999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.450999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:15.569840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:15.577692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f4c64248-9db4-481e-aa9a-8249161e68e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.152267 Oct 21 15:05:15.578339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 89/181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:15 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:15.621112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:15.622457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:15.628671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.629152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.629586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.630273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.630747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.631167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.769830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:15.777607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e278f581-67d0-44c1-ab83-662bf21d37f4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1556 microversion: 2.1 time: 0.160953 Oct 21 15:05:15.778172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 93/182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:15 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:15.801951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:15.802448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:15.809896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.810378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.810841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.811532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:15.812039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:15.812413 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:15.890581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-685c27d2-eff0-4e8b-9ed8-3b96a5137d2c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092626 Oct 21 15:05:15.891742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 90/183] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:05:15 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:16.464851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:16.465789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:16.472297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:16.472772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:16.473202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:16.473878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:16.474318 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:16.474881 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:16.602679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:16.604199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:16.611971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:16.612462 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:16.613431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:16.614348 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:16.615311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:16.615893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:16.861504 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:16.877888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:16.881334 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:16.882558 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f6d67600-08e2-463a-85ef-af6072f752e5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.422257 Oct 21 15:05:16.885536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 94/184] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:16 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:16.941922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:16.963090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-434e6190-2b21-4755-bf7a-9272c9f72733 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.363733 Oct 21 15:05:16.965301 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 91/185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:16 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:17.581850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53221d88-6f22-49de-9589-94759df68635", "tag": "8b960579-3161-44a9-932e-f96e86acfcad"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:17.604405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:17.604405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:17.604405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:17.608374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] Creating event network-changed:8b960579-3161-44a9-932e-f96e86acfcad for instance 53221d88-6f22-49de-9589-94759df68635 on hv-cinder-83608 Oct 21 15:05:17.613899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-f65aca3d-c6a3-43f6-9f8a-191ffedc426f req-a9b0f186-d3bf-4292-b5fa-afbebc8729dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035962 Oct 21 15:05:17.614924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 95/186] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:17.908908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:17.909532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:17.917112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:17.917940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:17.918379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:17.919244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:17.919761 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:17.920418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:17.997968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:18.003457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:18.016483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:18.019010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:18.019526 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:18.023136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:18.023699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:18.025365 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:18.408450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:18.421464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:18.422292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:18.423505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:18.424706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7d774436-2be0-41dc-bf16-ff62c82e8896 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1405 microversion: 2.20 time: 0.520445 Oct 21 15:05:18.434310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-22feaf19-93cb-42bd-af5f-c15c5eadc223 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.444508 Oct 21 15:05:18.435221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 96/187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:17 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:18.440148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 92/188] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:17 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:05:19.452931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:19.456615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:19.460986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.461712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.462388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.463347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.464012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.465199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.629426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:19.633565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:19.635125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:19.636940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-87b94695-6155-4d66-9044-0dcf8f8fb309 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1598 microversion: 2.20 time: 0.188054 Oct 21 15:05:19.637601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 97/189] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:05:19 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:05:19.637726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:19.638364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:19.644360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.644838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.645269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.646026 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.646484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.646968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.665109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:19.665610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:19.667591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=95 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:19.672218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.672705 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.673146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.673841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:19.674296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:19.674799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:19.772574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-68401783-5bc6-40f0-8484-4872a0e25285 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108244 Oct 21 15:05:19.772574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 98/190] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Oct 21 15:05:19 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 21 15:05:19.838272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:19.847517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-889cb6b4-5314-47f6-91aa-c7a43a5d063f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.213999 Oct 21 15:05:19.848436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 93/191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:19 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:20.872060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:20.872678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:20.879088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:20.879570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:20.880003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:20.880687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:20.881139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:20.881557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:21.026665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:21.030326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:21.035357 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8ae8a0ea-98e8-4407-8001-7936da649870 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.168280 Oct 21 15:05:21.044075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 99/192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:20 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:21.426894 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:21.438683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:21.438683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:21.438683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:21.449931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] Creating event network-changed:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:05:21.455098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-46eb840f-4200-401b-bbd2-fd01778a6f21 req-1fc28291-a4ec-4975-ae49-cfc1c5bb21ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Oct 21 15:05:21.455890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 94/193] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:05:22.060816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:22.062238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:22.069198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:22.070003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:22.070681 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:22.071623 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:22.072277 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:22.072903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:22.222353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:22.230971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-46548f8c-4de0-44d9-a250-5c728ddf4ca4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.174531 Oct 21 15:05:22.231566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 100/194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:22 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:23.256908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:23.257612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:23.267930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:23.271534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:23.271534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:23.271534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:23.271534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:23.272602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:23.429493 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:23.438296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-002c279f-6926-4af1-adba-0d2821031ad8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.185455 Oct 21 15:05:23.439319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 95/195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:23 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:24.461697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:24.462338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:24.471447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:24.471986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:24.472933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:24.473790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:24.474386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:24.474987 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:24.664919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:24.674352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8d6f393f-16d8-4d32-a40b-cc967237ba99 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.216742 Oct 21 15:05:24.675030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 101/196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:24 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:25.705495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:25.705495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:25.705495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:25.705495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:25.706340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:25.706340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:25.706497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:25.706845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:25.838096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:25.846625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3d3e1791-69eb-40aa-a855-a91b927f6f82 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.153159 Oct 21 15:05:25.847843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 96/197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:25 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:26.602766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:26.603327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:26.613268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:26.613760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:26.614269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:26.615024 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:26.615475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:26.615895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:26.646049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:05:26.869672 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:26.870274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:26.876707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:26.881628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:26.881628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:26.881628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:26.881628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:26.882013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:27.025801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:27.035386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6a362347-74d5-414d-8e6f-b23f1ddd28f2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.169585 Oct 21 15:05:27.036030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 97/198] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:26 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:27.057608 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6b20ec0d-3c86-4d38-83a2-43b465ba9722 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 204 len: 0 microversion: 2.1 time: 0.458485 Oct 21 15:05:27.059328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 102/199] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:05:26 2022] DELETE /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:05:27.074128 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:27.074883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:27.082441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:27.082955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:27.083769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:27.084720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:27.085357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:27.085961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:27.265999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:27.277857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-64e0e28c-c49e-492f-b502-821d4b257756 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1554 microversion: 2.1 time: 0.207975 Oct 21 15:05:27.278444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 98/200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:27 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:28.060704 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:28.061422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:28.068689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:28.069218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:28.069610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:28.070302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:28.070785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:28.071262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:28.211040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:28.219844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2a925a27-95e9-4db0-ad7d-c93cebd2d6f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.163683 Oct 21 15:05:28.220650 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 103/201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:28 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:28.301786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:28.302400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:28.308307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:28.308782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:28.309213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:28.310041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:28.310682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:28.311113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:28.443551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:28.452717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4c0c3f5c-f82f-4b1b-a69f-8c88e949f533 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1554 microversion: 2.1 time: 0.154783 Oct 21 15:05:28.453285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 99/202] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:28 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:29.244079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:29.244692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:29.252369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:29.252856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:29.253291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:29.253988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:29.255313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:29.262508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:29.430606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:29.447210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6c04b977-8020-459b-897e-bfc1aa97cc2e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.206974 Oct 21 15:05:29.448160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 104/203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:29 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:29.477697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:29.478941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:29.488505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:29.498871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:29.498871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:29.498871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:29.498871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:29.499162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:29.637713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:29.646749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d4a1ab1b-011a-43dd-b599-6bbe486ee493 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1554 microversion: 2.1 time: 0.173815 Oct 21 15:05:29.647577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 100/204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:29 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:29.938572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd539fde-6a8b-427a-aea0-fa13d89a7d65", "name": "network-vif-deleted", "tag": "85f359e2-b00b-4baa-a54e-0be68cf11c36"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:29.949608 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:29.950017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:29.950442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:29.965961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] Creating event network-vif-deleted:85f359e2-b00b-4baa-a54e-0be68cf11c36 for instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 on hv-cinder-83608 Oct 21 15:05:29.971970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-43b6b4ce-f30f-483d-b05e-518d1a3663bf req-dbeb4428-49c5-4016-9445-abf2a1a29504 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038317 Oct 21 15:05:29.973226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 105/205] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:30.471872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:30.472762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:30.480010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:30.480961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:30.481442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:30.482760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:30.483474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:30.484133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:30.643960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:30.652360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b9f82b48-d1e7-41f8-9a3a-aeb8363d74aa tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.185177 Oct 21 15:05:30.653181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 101/206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:30 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:30.678938 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:30.680454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:30.688674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:30.689317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:30.689997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:30.690903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:30.691664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:30.692229 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:30.729692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:30.730474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:30.731081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:30.731683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lazy-loading 'fault' on Instance uuid cd539fde-6a8b-427a-aea0-fa13d89a7d65 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:05:30.781883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:30.791677 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b4031e72-ed1f-459c-82c8-46f5770fb0c9 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1351 microversion: 2.1 time: 0.123434 Oct 21 15:05:30.806775 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 106/207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:30 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:31.676710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:31.677363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:31.683377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:31.683855 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:31.684279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:31.688763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:31.688763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:31.688763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:31.821999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:31.834658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:31.837834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:31.847867 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-71eb1703-b300-4f4d-b831-2c46dc5f8b75 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.174961 Oct 21 15:05:31.848660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 102/208] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:31 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:31.854343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:31.854896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:31.855489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:31.856359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:31.862023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:31.862618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:31.908953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:31.909923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:31.910427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:31.910979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lazy-loading 'fault' on Instance uuid cd539fde-6a8b-427a-aea0-fa13d89a7d65 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:05:31.996866 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ec83bb124455693573e6c68ff12fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6406e245a2fd4700aebba95795a18632', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:32.019203 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1af75d58-90ac-4108-bbf1-3e8bd901c503 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 200 len: 1351 microversion: 2.1 time: 0.199887 Oct 21 15:05:32.019994 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 107/209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:31 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:32.881616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:32.882278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:32.888435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:32.889011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:32.889456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:32.890148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:32.890576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:32.891020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:33.053301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:33.053915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:33.079062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:33.085478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:33.086165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:33.087146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:33.087773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:33.088477 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:33.111396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:33.121720 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] HTTP exception thrown: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.124032 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9807030e-b38a-43b6-9cf8-53ba5650192e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.246344 Oct 21 15:05:33.124776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 103/210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:32 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Request method failure captured: Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 HTTP/1.1 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT3evrzqJF7cMuNvppNYwmxOlLZv_U1UZdFJUbiB5b0LxOtPUu0xJlDy38ZzXOPlu294HhGu6EmGOW9DMSRqdWRwy8b9wSLVmGMcLyIMBPgv4iM1j1DfvldfXFWCQnp_uC9b4E348FAwMW17O4SyNMGf_oI2O9YKna3GO_7-efbloE Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:05:33.140112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6406e245a2fd4700aebba95795a18632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6406e245a2fd4700aebba95795a18632", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: c82ec83bb124455693573e6c68ff12fb Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.141673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'cd539fde-6a8b-427a-aea0-fa13d89a7d65'} Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:05:33.142550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.145473 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Returning 404 to user: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:05:33.146841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-83a5bc03-6d0c-498e-be6f-d8adc1420a1e tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 404 len: 111 microversion: 2.1 time: 0.097361 Oct 21 15:05:33.148717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 108/211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:33 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:05:33.331908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:33.334038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:33.347109 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:33.347724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:33.349866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:33.349866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:33.351980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:33.353135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:33.378262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] HTTP exception thrown: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Request method failure captured: Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65/os-volume_attachments HTTP/1.1 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT3evrzqJF7cMuNvppNYwmxOlLZv_U1UZdFJUbiB5b0LxOtPUu0xJlDy38ZzXOPlu294HhGu6EmGOW9DMSRqdWRwy8b9wSLVmGMcLyIMBPgv4iM1j1DfvldfXFWCQnp_uC9b4E348FAwMW17O4SyNMGf_oI2O9YKna3GO_7-efbloE Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:05:33.384201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6406e245a2fd4700aebba95795a18632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6406e245a2fd4700aebba95795a18632", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: c82ec83bb124455693573e6c68ff12fb Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.385417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'server_id': 'cd539fde-6a8b-427a-aea0-fa13d89a7d65'} Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:05:33.386279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:33.390234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:33.391382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Returning 404 to user: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:05:33.391382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-32991319-414b-4ac6-a6f4-3ffeca489d7b tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057858 Oct 21 15:05:33.391382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 104/212] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:05:33 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:05:34.154834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:34.154834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:34.157565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.158057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.158497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.159238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.159698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.160129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.307503 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:34.321746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c65ae47a-a9e4-489c-8462-b0bc5b87938c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.174885 Oct 21 15:05:34.322708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 109/213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:34 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:34.897335 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:34.897837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:34.905252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.905739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.906233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.906950 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.907393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.907806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] HTTP exception thrown: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Request method failure captured: Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 HTTP/1.1 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT3evrzqJF7cMuNvppNYwmxOlLZv_U1UZdFJUbiB5b0LxOtPUu0xJlDy38ZzXOPlu294HhGu6EmGOW9DMSRqdWRwy8b9wSLVmGMcLyIMBPgv4iM1j1DfvldfXFWCQnp_uC9b4E348FAwMW17O4SyNMGf_oI2O9YKna3GO_7-efbloE Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:05:34.930142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6406e245a2fd4700aebba95795a18632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6406e245a2fd4700aebba95795a18632", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: c82ec83bb124455693573e6c68ff12fb Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.931688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'cd539fde-6a8b-427a-aea0-fa13d89a7d65'} Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:05:34.932536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.933794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.935365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Returning 404 to user: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:05:34.935365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-00e729ad-eb12-4777-9a7f-8065ee3ef983 tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 404 len: 111 microversion: 2.1 time: 0.034541 Oct 21 15:05:34.935365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 105/214] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:05:34 2022] DELETE /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:05:34.936464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:34.937113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] [instance: cd539fde-6a8b-427a-aea0-fa13d89a7d65] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:34.943051 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.943535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.943963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.944657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:34.945124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:34.945530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:34.964785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] HTTP exception thrown: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Request method failure captured: Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 HTTP/1.1 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT3evrzqJF7cMuNvppNYwmxOlLZv_U1UZdFJUbiB5b0LxOtPUu0xJlDy38ZzXOPlu294HhGu6EmGOW9DMSRqdWRwy8b9wSLVmGMcLyIMBPgv4iM1j1DfvldfXFWCQnp_uC9b4E348FAwMW17O4SyNMGf_oI2O9YKna3GO_7-efbloE Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:05:34.969811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6406e245a2fd4700aebba95795a18632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6406e245a2fd4700aebba95795a18632"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6406e245a2fd4700aebba95795a18632", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 6406e245a2fd4700aebba95795a18632 Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-DeleteServersTestJSON-417427499 Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: c82ec83bb124455693573e6c68ff12fb Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-DeleteServersTestJSON-417427499-project Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.971390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'cd539fde-6a8b-427a-aea0-fa13d89a7d65'} Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:05:34.972183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. Oct 21 15:05:34.973458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:05:34.974605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] Returning 404 to user: Instance cd539fde-6a8b-427a-aea0-fa13d89a7d65 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:05:34.974605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c16d72cb-15fd-4306-aa04-11a4f118cb2d tempest-DeleteServersTestJSON-417427499 tempest-DeleteServersTestJSON-417427499-project] 10.222.0.60 "GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65" status: 404 len: 111 microversion: 2.1 time: 0.035828 Oct 21 15:05:34.974605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 110/215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:34 2022] GET /compute/v2.1/servers/cd539fde-6a8b-427a-aea0-fa13d89a7d65 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:05:35.345920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:35.346858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:35.353159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:35.353933 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:35.354429 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:35.355466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:35.356131 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:35.360321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:35.509544 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:35.519127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d2bfe1d2-a22d-4bdc-8c7a-a26f3aec69c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.177226 Oct 21 15:05:35.522730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 106/216] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:35 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:36.541687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:36.542454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:36.560693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:36.561218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:36.561651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:36.562536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:36.563281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:36.563860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:36.867087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:36.879883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6e48a781-691a-4470-b838-9fa5f0f0f6c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.340317 Oct 21 15:05:36.882959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 111/217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:36 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:37.909101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:37.910415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:37.923190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:37.924786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:37.924786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:37.925902 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:37.926571 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:37.928022 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:38.196275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:38.203653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0639778b-06a9-45bd-9f9d-200de78cb447 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.304199 Oct 21 15:05:38.205497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 107/218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:37 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:39.235524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:39.238200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:39.246093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:39.246864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:39.248978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:39.249940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:39.250544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:39.251187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:39.501800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:39.516866 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b0573bf1-820b-4948-b1e9-c55a6045d70e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.287505 Oct 21 15:05:39.517773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 112/219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:39 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:40.541650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:40.542276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:40.549226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:40.549837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:40.550460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:40.551658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:40.552343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:40.553187 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:40.569893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:40.719158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:40.732217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-700c67d9-c9ad-4153-89b4-c4e8443f99fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.194040 Oct 21 15:05:40.740800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 108/220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:40 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:41.765013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:41.765697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:41.773004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:41.773722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:41.774145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:41.775088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:41.775710 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:41.776113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:41.926870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:41.936148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-630aaa19-2064-45c9-8814-4f9a3b47438b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.183745 Oct 21 15:05:41.936721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 113/221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:41 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:42.959954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:42.960511 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:42.983959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=49 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:42.994373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:42.994888 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:42.995500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:42.996392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:42.997650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:42.998265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:43.145514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:43.153194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ee1f083f-b9ec-4463-8811-5ecea2651068 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.197731 Oct 21 15:05:43.154905 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 109/222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:42 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:43.487460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-599939036", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "networks": [{"uuid": "ec752088-4369-4b35-899f-5f1663dac72e"}]}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:43.549669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] validate_networks() for [('ec752088-4369-4b35-899f-5f1663dac72e', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:05:44.178825 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:44.180037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:44.187225 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:44.188046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:44.188762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:44.189913 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:44.190763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:44.191215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:44.331174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:05:44.331599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:05:44.332093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:05:44.332540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:05:44.332957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:05:44.346407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:44.346407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:44.346407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:44.346407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:44.346764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:44.346764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:44.363403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Getting quotas for project 780201e2794a47c294b91f39978cfbf4. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:05:44.368087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Getting quotas for user 6b59e9b0ec6e4fee99a93c58f9dcd6ba and project 780201e2794a47c294b91f39978cfbf4. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:05:44.382189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:44.382654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:05:44.385012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:05:44.391128 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0d7ac9d7-ac94-4ef1-a45b-3f848ab87278 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.216465 Oct 21 15:05:44.391842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 110/223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:44 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:44.514020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-af1ad0ad-e936-4c5c-8c9c-a9a6b221417b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030342 Oct 21 15:05:44.514951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 114/224] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:05:44.527926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b53e6e2b-d001-467d-ae78-eeb969496bab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:44.528841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b53e6e2b-d001-467d-ae78-eeb969496bab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:44.602842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b53e6e2b-d001-467d-ae78-eeb969496bab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:44.611957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b53e6e2b-d001-467d-ae78-eeb969496bab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1213 microversion: 2.1 time: 0.089021 Oct 21 15:05:44.631138 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 111/225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:44 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:45.414925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:45.415877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:45.424506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:45.424984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:45.425488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:45.426092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:45.426546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:45.426975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:45.577548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:45.587446 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2d3b9631-09b1-4720-ac95-bb2343c3b79f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.177034 Oct 21 15:05:45.588041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 115/226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:45 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:45.652786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9350926a-2ea9-41d2-863e-8d82a22f3f58 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:45.654038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9350926a-2ea9-41d2-863e-8d82a22f3f58 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:45.713271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9350926a-2ea9-41d2-863e-8d82a22f3f58 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:45.721685 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9350926a-2ea9-41d2-863e-8d82a22f3f58 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1213 microversion: 2.1 time: 0.078660 Oct 21 15:05:45.722247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 112/227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:45 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:46.613137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:46.624341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:46.645728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:46.647257 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:46.647875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:46.649031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:46.649416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:46.650232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:46.752635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:46.753487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:46.772530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:46.773251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:46.773837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:46.775163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:46.776073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:46.776868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:46.880963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:46.885324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:46.889222 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:46.889659 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0ab0e057-7495-4f73-bf5a-d63246b3f87e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1209 microversion: 2.1 time: 0.149138 Oct 21 15:05:46.890244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 113/228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:46 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:46.893914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a1095839-60f4-4c3b-9af0-e527dce4ca98 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.285452 Oct 21 15:05:46.894505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 116/229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:46 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:47.913609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:47.914220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:47.917502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:47.918124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:47.922706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:47.923381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:47.924013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:47.924863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:47.925455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:47.926019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:47.927187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:47.927754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:47.929012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:47.930362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:47.930941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:47.931500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:48.058604 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:48.067948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2ae4f6d6-24fd-496d-8129-d3fc72cd8024 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1265 microversion: 2.1 time: 0.158427 Oct 21 15:05:48.069048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 114/230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:47 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:48.243904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:48.252557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a9c12542-d311-403f-b454-a32a1dedb3c6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.339094 Oct 21 15:05:48.253167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 117/231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:47 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:49.100292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:49.102278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:49.118516 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:49.122433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:49.124552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:49.125534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:49.128081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:49.128625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:49.209428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:49.219204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a3b1577c-dd9a-4aed-883f-d5f435c1f1ab tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1265 microversion: 2.1 time: 0.130414 Oct 21 15:05:49.219780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 115/232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:49 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:49.276464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:49.277447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:49.285137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:49.286472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:49.287240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:49.287963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:49.288509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:49.289073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:49.456837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:49.471610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c95f5988-12a2-4420-8f45-7c2aa1d5c13d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1521 microversion: 2.1 time: 0.193413 Oct 21 15:05:49.471610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 118/233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:49 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:50.243741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:50.244436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:50.251788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.252354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.252872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.253648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.262310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.263715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.421411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:50.437837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-97efadde-1962-4c86-8806-e299a1c6323f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1273 microversion: 2.1 time: 0.198833 Oct 21 15:05:50.438646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 116/234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:50 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:50.495035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:50.496256 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:50.514995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.515554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.516070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.516780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.517328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.519869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.713186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:50.750617 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9a0eab75-fed2-4fe8-ae28-e32c323fb129 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1501 microversion: 2.1 time: 0.256414 Oct 21 15:05:50.751578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 119/235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:50 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:50.772967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:50.773631 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:50.780486 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.781007 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.781535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.782454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:50.783129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:50.783556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:50.962931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:50.989886 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-52d9b4ce-6357-4c5e-884d-7339a532b636 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1515 microversion: 2.1 time: 0.220739 Oct 21 15:05:50.995275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 117/236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:50 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:51.465496 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:51.469423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:51.471653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:51.480436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:51.483028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:51.485438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:51.486261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:51.486786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:51.487211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:51.699972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:51.712333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-17f016ae-36e3-4bf9-99f3-73cca047c553 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.250105 Oct 21 15:05:51.713763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 120/237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:51 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:52.403451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b24d3862-2d4f-4b38-b779-9de658059fa2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: .version_select at 0x7fd1e0fbc0d0>, body: {"keypair": {"name": "tempest-keypair-1641899690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Nj9OJ1bZa+76Q9/LLjOjM5fZGdGvCHxib1Gx/wfyTTPZzvUs1JNdnt80HvOVm8u1zvwul8BdoiwMeYPp3xITT25+LBw/fnAvapmotQb2qHheM5U/LL891obGYb61iXA=="}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:52.435351 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-b24d3862-2d4f-4b38-b779-9de658059fa2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for project 0025ac2cdc0f45dab742a02486307716. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:05:52.440504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-b24d3862-2d4f-4b38-b779-9de658059fa2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for user 3418ee58bd51418d9594b98ed594f506 and project 0025ac2cdc0f45dab742a02486307716. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:05:52.556594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b24d3862-2d4f-4b38-b779-9de658059fa2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306560 Oct 21 15:05:52.557102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 118/238] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:05:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:05:52.738598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:52.739208 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:52.753433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:52.753433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:52.753433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:52.753433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:52.753969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:52.753969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:52.887701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031968f0-826a-4c00-bfc4-efba5d81adcc", "tag": "b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:52.906130 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:52.906946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:52.928261 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:52.941790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:52.969321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] Creating event network-changed:b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2 for instance 031968f0-826a-4c00-bfc4-efba5d81adcc on hv-cinder-83608 Oct 21 15:05:52.982549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-6ecbf4e4-8e77-495c-9a22-fa769533242f req-f6ad7c95-3433-4b21-a863-255609995778 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096599 Oct 21 15:05:52.985750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 119/239] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:05:53.006877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-80852545-0858-474d-8a53-3608ce07eb55 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.253346 Oct 21 15:05:53.006877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 121/240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:52 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:53.145381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:53.147750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:53.155730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:53.156556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:53.157211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:53.158121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:53.159091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:53.159716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:53.219654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'flavor' on Instance uuid 96d3f579-4139-41ae-a20b-b25f1c6b95a7 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:05:53.631419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-22e4df33-7416-4bb4-888b-e702ee847560 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/action" status: 200 len: 32 microversion: 2.1 time: 0.480232 Oct 21 15:05:53.636948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 120/241] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:05:53 2022] POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/action => generated 32 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:05:53.646339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:53.647313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:53.657206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:53.657956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:53.658561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:53.659693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:53.660337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:53.661931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:53.938981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:53.948756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-106826ce-728b-4b0c-87f6-f5c0153be598 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.305473 Oct 21 15:05:53.949575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 122/242] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:53 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:54.018700 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:54.020102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:54.027474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:54.028231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:54.028919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:54.029776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:54.030583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:54.031177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:54.209592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:54.229705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4b0702a8-5f5d-4c8e-a50d-ca792bbc6e7d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.203695 Oct 21 15:05:54.229964 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 121/243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:54 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:54.976223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:54.978035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:54.988347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:54.989281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=6 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:54.991742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:54.992445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:54.993125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:54.994049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:54.994902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:54.995420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:55.187792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:55.198739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b7a0acdb-d5ec-4105-9d93-b4027e431d76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.229617 Oct 21 15:05:55.199613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 123/244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:54 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:55.241758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:55.242664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:55.251279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:55.251956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:55.252592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:55.253463 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:55.254083 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:55.254677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:55.430509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:55.444650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7d9c5ae9-f331-4343-b86d-74e94c869efc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.207163 Oct 21 15:05:55.446105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:55 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:55.935461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-583733910", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ba9c68-98e6-41b9-b0e4-cb7cb4592b59"}], "security_groups": [{"name": "tempest-securitygroup--1830335690"}], "key_name": "tempest-keypair-1641899690", "user_data": "}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:05:56.056029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] validate_networks() for [('21ba9c68-98e6-41b9-b0e4-cb7cb4592b59', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:05:56.223663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:56.224514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:56.230911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.231449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.232111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.232944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.233440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.233873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.467309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:56.475434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-36154107-285f-4d01-ba74-e5338e5da8df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.255774 Oct 21 15:05:56.476030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 123/246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:56 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:56.480550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:56.481665 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:56.487853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.488339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.488770 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.489456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.489988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.490417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.511660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:05:56.512088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:05:56.512568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:05:56.512974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:05:56.513582 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:05:56.522070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.522862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.523486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.524395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:56.524855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:56.525282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:56.542905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for project 0025ac2cdc0f45dab742a02486307716. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:05:56.547956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for user 3418ee58bd51418d9594b98ed594f506 and project 0025ac2cdc0f45dab742a02486307716. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:05:56.559054 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:05:56.561932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:05:56.628487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:56.636478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-15db959b-713d-4b4d-bcef-6eb4befc6d1e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.159460 Oct 21 15:05:56.637091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 124/247] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:56 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:56.688004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-646b368a-6487-498a-8cc1-d744db1ceab8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.756830 Oct 21 15:05:56.688657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 124/248] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:05:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:05:56.699745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6c44ab96-147a-454b-ad63-86b12965b0fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:56.700494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6c44ab96-147a-454b-ad63-86b12965b0fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:56.775519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6c44ab96-147a-454b-ad63-86b12965b0fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:56.789073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6c44ab96-147a-454b-ad63-86b12965b0fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1237 microversion: 2.1 time: 0.093053 Oct 21 15:05:56.790146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 125/249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:56 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:57.499926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:57.500735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:57.507110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:57.507594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:57.508028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:57.508722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:57.509172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:57.509599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:57.646655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:57.656869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7a3f9fac-0d90-43bd-902a-54d40700be41 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.161221 Oct 21 15:05:57.670670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 125/250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:57 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:57.670873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:57.670873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:57.673579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:57.674249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:57.674583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:57.675325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:57.675780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:57.676200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:57.814099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e5b6ae55-2380-43af-a21d-28ece9883604 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:57.815126 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e5b6ae55-2380-43af-a21d-28ece9883604 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:57.874485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:57.885914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-63b5a1a3-b113-42e0-807f-0f4da6470918 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.230129 Oct 21 15:05:57.886739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 126/251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:57 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:57.922061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e5b6ae55-2380-43af-a21d-28ece9883604 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:57.929327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e5b6ae55-2380-43af-a21d-28ece9883604 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1237 microversion: 2.1 time: 0.119929 Oct 21 15:05:57.930172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 126/252] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:57 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:58.681046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:58.681653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:58.688436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.688916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.689347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:58.690031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.690482 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.690942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:58.708787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:05:58.823093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:58.830764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dd6286c4-3d94-4c24-a880-6d6757a2abf3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.153513 Oct 21 15:05:58.831416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 127/253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:58 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:58.910742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:58.911134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:58.918130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.919199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.919802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:58.920500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.920960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.921388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:58.952082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:58.952787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:58.959470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.960347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.960777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:58.961507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:58.961960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:58.962505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:59.038671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:59.047860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d688b1cd-8248-4055-beb8-073c386f6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1241 microversion: 2.1 time: 0.099624 Oct 21 15:05:59.048419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 128/254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:58 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:05:59.075271 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:05:59.083072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-55ca1287-5d6c-4c13-b6eb-f7efe0a72bf3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.176596 Oct 21 15:05:59.083669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 127/255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:58 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:05:59.853549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:05:59.854145 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:05:59.861040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:59.861522 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:59.861946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:59.862621 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:05:59.863093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:05:59.863506 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:05:59.996312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:00.005177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-79aee340-7070-456d-b406-dc71adcc0b43 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.155766 Oct 21 15:06:00.005735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 129/256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:05:59 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:00.071692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:00.072225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:00.079751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:00.080230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:00.082854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:00.082854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:00.082854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:00.082854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:00.106329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:00.106970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:00.113928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:00.114113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:00.114653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:00.115226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:00.115705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:00.116128 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:00.148567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:00.157091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ae97213e-e5a4-4400-868f-7134ee614646 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1241 microversion: 2.1 time: 0.089335 Oct 21 15:06:00.157665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 128/257] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:00 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:00.251012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:00.258686 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1b843ab0-78d1-493f-b21f-3879fb96bb17 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.156127 Oct 21 15:06:00.259238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 130/258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:00 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:01.029137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:01.029667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:01.035630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.036111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.036541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.037225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.037679 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.038099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.181051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:01.182387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:01.189400 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:01.189975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.190460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.190931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.191619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.192365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.195823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.198604 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f9e2137e-342f-447a-b23e-80a3bc39b0e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.173521 Oct 21 15:06:01.199289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 129/259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:01 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:01.264735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:01.272756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-afead1d4-5d3d-4efc-bad3-b39e35004a93 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1289 microversion: 2.1 time: 0.095557 Oct 21 15:06:01.282018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 131/260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:01 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:01.283742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:01.284597 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:01.291750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.292312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.292933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.293892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:01.294534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:01.295057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:01.434959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:01.444251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-58e94e18-8ee2-4912-89e1-3e242a21e4e1 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.166120 Oct 21 15:06:01.454444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 130/261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:01 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:02.224934 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:02.225546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:02.233193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.233798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.234508 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.235355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.235983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.236558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.298088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:02.298728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:02.307691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.308212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.310117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.311188 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.312646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.313265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.406141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:02.426085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9762bec9-1193-4a45-ace6-4748337dc40e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1307 microversion: 2.1 time: 0.132827 Oct 21 15:06:02.430203 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 131/262] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:02 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:02.441423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:02.464105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-42426ff7-ee01-4fae-8cab-c2553c86e247 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.233678 Oct 21 15:06:02.468150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:02.468769 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:02.471208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 132/263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:02 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:02.486862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.487366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.487803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.488509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:02.489074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:02.489493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:02.631331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:02.640723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-969fc158-8007-4028-ae1c-17a73bb011bd tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.176550 Oct 21 15:06:02.641312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 132/264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:02 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:03.219125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031968f0-826a-4c00-bfc4-efba5d81adcc", "name": "network-vif-plugged", "status": "completed", "tag": "b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:03.229143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.229709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.230032 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.242428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] Creating event network-vif-plugged:b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2 for instance 031968f0-826a-4c00-bfc4-efba5d81adcc on hv-cinder-83608 Oct 21 15:06:03.249334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-aadc6e46-9a23-4b07-adab-a12930a123bc req-10d49c54-5a13-409d-a885-462028307e49 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034723 Oct 21 15:06:03.249937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 133/265] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:03.457590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:03.458215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:03.471733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.472596 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.473162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.474293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.474832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.475268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.489639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:03.490536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:03.501332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.503219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.503682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.504396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.504852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.505271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.682465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:03.696004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2c1e90aa-8d32-4375-a6e1-59c107d0ff96 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.242858 Oct 21 15:06:03.703506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 133/266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:03 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:03.703506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:03.703506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:03.708871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.710249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.710979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.711893 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:03.712554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:03.713180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:03.731124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:03.740593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b5eb44a6-e305-429c-979f-a83c0b3033e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.255649 Oct 21 15:06:03.741481 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 134/267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:03 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:03.861858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:03.869581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b0973fce-7a87-42f3-ac61-aa641f05cad3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.171522 Oct 21 15:06:03.870148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 134/268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:03 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:04.420740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fd0142-c1a4-480c-9c84-114dea2d4a78", "tag": "455afb50-1871-4c92-8e2c-a7238ea79181"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:04.430108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:04.430719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:04.431275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:04.442481 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] Creating event network-changed:455afb50-1871-4c92-8e2c-a7238ea79181 for instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 on hv-cinder-83608 Oct 21 15:06:04.447788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-2e7ae013-e98c-42c6-826f-e6e189d55051 req-d6419e91-805b-4b52-8982-2445aa18cffe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031512 Oct 21 15:06:04.448599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 135/269] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:04.720532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:04.721109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:04.727942 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:04.728422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:04.728855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:04.729554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:04.730006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:04.730429 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:04.735331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:04.767715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:04.768413 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:04.774852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:04.775330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:04.778609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:04.778609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:04.778609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:04.778609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:04.921723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:04.939974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9754f0ec-e0bb-4ca5-aeef-08c54134d4cc tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.220555 Oct 21 15:06:04.941341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 135/270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:04 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:04.971696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:04.972746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:05.001864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:05.002846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:05.003595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:05.004898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:05.005683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:05.006407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:05.011580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:05.035590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d09196b3-65be-4d30-8c26-55d229100019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.273619 Oct 21 15:06:05.041423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 136/271] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:04 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:05.233388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:05.243756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7dfa1e46-d63f-47a6-b1ef-202aafbacede tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1313 microversion: 2.1 time: 0.296635 Oct 21 15:06:05.245172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 136/272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:04 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:05.967563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:05.968142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:05.977978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:05.978602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:05.979186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:05.980073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:05.980634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:05.981194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:06.068223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:06.069432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:06.078398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:06.079028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:06.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:06.080467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:06.081080 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:06.081667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:06.168253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:06.186598 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a240eeca-c294-4da6-a838-c0356c33f294 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.223540 Oct 21 15:06:06.187437 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:05 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:06.245413 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:06.255316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-91df928d-699c-47e4-916f-1f96d8c1fe5a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.193222 Oct 21 15:06:06.259605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 137/274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:06 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:06.270830 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:06.271708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:06.283978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:06.284999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:06.285681 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:06.287860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:06.291276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:06.291812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:06.439568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:06.447762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3fa03156-894c-4e9e-9e6e-b4066ee50c6d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1497 microversion: 2.1 time: 0.180851 Oct 21 15:06:06.449732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 138/275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:06 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:07.210761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:07.211383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:07.213200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:07.219117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.219608 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.220139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.220785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.221242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.221670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.290949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:07.290949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:07.296805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=10 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:07.302529 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.313543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.314119 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.314921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.317544 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.318003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.396790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:07.410740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-231b4752-a05e-4106-8369-727b9c71c9fb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.202668 Oct 21 15:06:07.411550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 138/276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:07 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:07.419208 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:07.420004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:07.429656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.430975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.432512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.433547 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:07.435023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:07.435832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:07.477362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:06:07.505945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:07.514852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e2bcb826-7dc0-4149-98b1-f27c15520192 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.233365 Oct 21 15:06:07.515689 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 139/277] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:07 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:07.928876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=8 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:07.986230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ab3bfd78-0f7c-4c10-ac55-227f3237af8d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "DELETE /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 204 len: 0 microversion: 2.1 time: 0.571502 Oct 21 15:06:07.986510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 139/278] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:06:07 2022] DELETE /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:06:07.994817 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:07.995514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:08.002294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.002885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.003379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.004327 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.007995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.007995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.148177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:08.158802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8da51823-b4e5-46a7-8932-11d483fd0da6 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1503 microversion: 2.1 time: 0.167659 Oct 21 15:06:08.168273 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 140/279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:07 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:08.435853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:08.437085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:08.443732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.444218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.444652 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.445383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.445840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.446262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.542558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:08.544391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:08.550440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.551322 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.551566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.552308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:08.552917 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:08.553336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:08.591411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:08.614725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a387b00a-09e4-4434-b469-f7c29218b48b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.170768 Oct 21 15:06:08.614725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 140/280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:08 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:08.704993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:08.715717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f3e29ab8-8e0b-4684-bb4d-f17da9a5310f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.178657 Oct 21 15:06:08.716296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 141/281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:08 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:09.183405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:09.184095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:09.191037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.191512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.191944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.192624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.193071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.193484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.335352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:09.343746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8d733145-5faf-4f9c-9499-ea5b7b948d32 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1503 microversion: 2.1 time: 0.164257 Oct 21 15:06:09.344282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 141/282] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:09 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:09.626441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:09.630816 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:09.634676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.635663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.636590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.638765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.639764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.640289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.740216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:09.741457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:09.749317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.749890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.750389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.751643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:09.752566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:09.753179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:09.783931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:09.795675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0341df4b-0311-4b15-afdb-d7a657c24c67 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.173781 Oct 21 15:06:09.796264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 142/283] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:09 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:09.923268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:09.939701 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-04ea3cd9-e66f-4dc9-9261-e91d6646f821 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.203315 Oct 21 15:06:09.945844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 142/284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:09 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:10.321949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031968f0-826a-4c00-bfc4-efba5d81adcc", "name": "network-vif-deleted", "tag": "b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:10.342341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.342341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.342341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.357989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] Creating event network-vif-deleted:b81d2deb-2f6d-46d1-b2af-cb5a39b3e2d2 for instance 031968f0-826a-4c00-bfc4-efba5d81adcc on hv-cinder-83608 Oct 21 15:06:10.363321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-e4edbbbb-1598-4250-b50a-101fc28650d8 req-b1ec6553-b43f-4ccf-a3af-78bc26d14321 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045306 Oct 21 15:06:10.364003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 143/285] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:10.371067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:10.373179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:10.379946 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.380507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.380953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.381859 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.382287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.382787 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.456174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:10.466836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4dbe50b4-fa2f-4ac3-89f1-315d8d7b6ebc tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1461 microversion: 2.1 time: 0.099778 Oct 21 15:06:10.467555 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 143/286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:10 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:10.820547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:10.824155 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:10.829242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.829717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.830163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.831094 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.831697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.832167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.968089 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:10.969125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:10.983895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.984484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.985409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.986189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:10.986747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:10.987416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:10.989795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:11.000038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e76f50ae-5298-42bf-95f4-62286776f504 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.183825 Oct 21 15:06:11.001477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 144/287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:10 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:11.129357 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:11.138838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3ca6b97c-bd4f-4d09-8eb0-d855356b0ae7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.175462 Oct 21 15:06:11.139424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:10 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:11.205770 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd0142-c1a4-480c-9c84-114dea2d4a78", "name": "network-vif-plugged", "status": "completed", "tag": "455afb50-1871-4c92-8e2c-a7238ea79181"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:11.215716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:11.216290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:11.216726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:11.227432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] Creating event network-vif-plugged:455afb50-1871-4c92-8e2c-a7238ea79181 for instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 on hv-cinder-83608 Oct 21 15:06:11.232375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-a664a915-d6e6-4d1e-a81a-4d279e7ea5e3 req-eec3f8f8-c634-4370-a0e9-152e2b64a4f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Oct 21 15:06:11.232970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 145/289] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:06:11.492005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:11.492762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:11.499107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:11.499602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:11.500040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:11.500736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:11.501193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:11.501613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:11.534842 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:11.535463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:11.535978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:11.536430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lazy-loading 'fault' on Instance uuid 031968f0-826a-4c00-bfc4-efba5d81adcc {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:11.582694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:11.591043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e2d255e1-720d-4122-a258-bd2a66478e20 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1303 microversion: 2.1 time: 0.102820 Oct 21 15:06:11.591952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 145/290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:11 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:12.040977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:12.040977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:12.040977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.040977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.041999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.041999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.041999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.041999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.161817 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:12.162544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:12.171573 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.172474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.173125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.174082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.174824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.175714 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.180661 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:12.184455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:12.189841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1abdfac2-b6e6-44e0-856a-ebc4c2951b32 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.167863 Oct 21 15:06:12.189841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 146/291] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:12 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:12.314091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:12.321724 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-113746c5-b9b5-4382-9bf9-448ebf153f8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.164112 Oct 21 15:06:12.322288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:12 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:12.616142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:12.616746 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:12.623485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.623965 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.624519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.625201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.625649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.626067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.657479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:12.657961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:12.658421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:12.658883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lazy-loading 'fault' on Instance uuid 031968f0-826a-4c00-bfc4-efba5d81adcc {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:12.709724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:12.718031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c4b03386-73e9-4bfc-856e-220d0ed08ee4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1303 microversion: 2.1 time: 0.106092 Oct 21 15:06:12.718803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 147/293] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:12 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:13.211106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:13.211713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:13.218348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.218869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.219304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.220032 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.220487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.220911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.282784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:13.283331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:13.289459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.289949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.290849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.291386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.291840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.292287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.319727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1f570d77-1a9d-47b5-bbfb-486cbfd06b68 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/ips" status: 200 len: 149 microversion: 2.1 time: 0.041307 Oct 21 15:06:13.320185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 148/294] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:06:13 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:06:13.346428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:13.347071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:13.352218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:13.353183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.353678 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.354108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.354828 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.355284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.357201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.361974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c1ead316-3743-4cb8-96e6-dfb6c202d71c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.154704 Oct 21 15:06:13.362584 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 147/295] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:13 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:13.488710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:13.496373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7ba3dec7-9aa5-4892-805f-6f38d163aa03 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.154339 Oct 21 15:06:13.497520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 149/296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:13 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:13.741478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:13.742264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:13.748444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.748915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.749371 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.750050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.750496 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.750948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.782214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:13.782794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:13.783268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:13.783858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lazy-loading 'fault' on Instance uuid 031968f0-826a-4c00-bfc4-efba5d81adcc {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:13.827383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:13.835251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a4d6ad6d-0f2b-47a5-93f4-b27bea059186 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 200 len: 1303 microversion: 2.1 time: 0.097605 Oct 21 15:06:13.835966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 148/297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:13 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:14.386409 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:14.387105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:14.389300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:14.394179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.394927 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.395579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.396637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.397254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.397680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.519886 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:14.520495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:14.527200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.527686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.528684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.529499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.529953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.530376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.534816 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:14.543379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d2bc3958-4205-4085-b24c-b3e5f22c0600 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.161703 Oct 21 15:06:14.544006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 150/298] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:14 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:14.554209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:14.666193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:14.674017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-71a75286-970b-44eb-8f76-f6781b1559ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.158122 Oct 21 15:06:14.674607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 149/299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:14 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:14.858238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:14.858911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 031968f0-826a-4c00-bfc4-efba5d81adcc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:14.865110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.865620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.866053 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.866766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.867214 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.867626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.881789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] HTTP exception thrown: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Request method failure captured: Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc HTTP/1.1 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrVFtPMaaHsJavHhtyf6h8dhM3qItKAW_Xc_1Ij5p6Kahtwn1oaTDMF4dX_f9zDEUTc0UpcQnWOJ9cQ6L3MT4rdiFdwvIHO7uKOOvWmgVHxlkahBptKcxGMoNcb7oqsS_4QCpXSM8FhoP4Qirm0230XIQynSSahioIEQ8lCijGWc94g Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 780201e2794a47c294b91f39978cfbf4 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:06:14.883443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_780201e2794a47c294b91f39978cfbf4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 780201e2794a47c294b91f39978cfbf4 Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesActionsTest-1469373008-project Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 6b59e9b0ec6e4fee99a93c58f9dcd6ba Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesActionsTest-1469373008-project Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. Oct 21 15:06:14.884960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '031968f0-826a-4c00-bfc4-efba5d81adcc'} Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:06:14.885774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. Oct 21 15:06:14.887236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:14.890985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Returning 404 to user: Instance 031968f0-826a-4c00-bfc4-efba5d81adcc could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:06:14.890985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-015b156a-68f2-4fdb-b25f-3dddcbcda3d0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc" status: 404 len: 111 microversion: 2.1 time: 0.031284 Oct 21 15:06:14.890985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 151/300] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:14 2022] GET /compute/v2.1/servers/031968f0-826a-4c00-bfc4-efba5d81adcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:06:14.972287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1fb98b0-203b-448a-a972-6a24f24d4025"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:14.975664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:14.983130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.983622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.984059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:14.984755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:14.985206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:14.985707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.003071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-181565003", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "networks": [{"uuid": "ec752088-4369-4b35-899f-5f1663dac72e"}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:15.060297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] validate_networks() for [('ec752088-4369-4b35-899f-5f1663dac72e', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:06:15.468916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:06:15.469489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:06:15.469860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:06:15.470268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:06:15.471067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:06:15.483467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.483957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.484387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.485116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.485566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.485987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.511912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Getting quotas for project 780201e2794a47c294b91f39978cfbf4. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:06:15.517533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Getting quotas for user 6b59e9b0ec6e4fee99a93c58f9dcd6ba and project 780201e2794a47c294b91f39978cfbf4. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:06:15.530505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:06:15.532856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:06:15.716591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8b978c2c-cbfd-4694-9a9f-02496ffb6114 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717011 Oct 21 15:06:15.717302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 152/301] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:06:15.721800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:15.722659 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:15.729437 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.733518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.733518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.733518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.733518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.733850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.881301 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:15.889410 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-35474201-21ba-42d6-b9f0-4319061e40de tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.170985 Oct 21 15:06:15.890089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 153/302] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:15 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:15.894675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:15.895287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:15.901300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.901786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.908253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:15.908253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:15.908253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:15.908253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:16.079504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:16.087858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-24fef5ad-376b-4432-b030-7d114a0dda8b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.196510 Oct 21 15:06:16.088127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 154/303] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:15 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:16.090375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bb60a2fe-d582-436c-a1a7-8de65f00428b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124042 Oct 21 15:06:16.091465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 150/304] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:06:14 2022] POST /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:16.092895 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2f50eaa5-eae2-4e97-bdb5-b9b4345d312b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:16.093530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2f50eaa5-eae2-4e97-bdb5-b9b4345d312b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:16.172738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2f50eaa5-eae2-4e97-bdb5-b9b4345d312b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:16.182926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2f50eaa5-eae2-4e97-bdb5-b9b4345d312b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1213 microversion: 2.1 time: 0.090805 Oct 21 15:06:16.182926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 155/305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:16 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:16.686511 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:16.687316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:16.694106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:16.694598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:16.695524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:16.695854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:16.696314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:16.696737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:16.721808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-db63b386-4f86-4c4b-be92-45740e88ba3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/ips" status: 200 len: 153 microversion: 2.20 time: 0.040049 Oct 21 15:06:16.722961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 151/306] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Oct 21 15:06:16 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:06:16.912810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:16.913424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:16.923717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:16.924239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:16.924677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:16.925398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:16.925850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:16.926264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:17.074149 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:17.082856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f547c643-357a-45d5-afbd-388fd89f7666 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.173742 Oct 21 15:06:17.083422 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 156/307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:16 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:17.112728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:17.113425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:17.120213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:17.120796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:17.121297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:17.123642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:17.123642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:17.123957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:17.204699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:17.205341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:17.212707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:17.213207 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:17.213675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:17.214748 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:17.216181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:17.216781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:17.297223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:17.300743 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:17.302121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-62374e91-e661-4159-8573-2198243a3eec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1217 microversion: 2.1 time: 0.101545 Oct 21 15:06:17.302718 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 157/308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:17 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:17.308476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-dc5bdf09-1695-4718-8d09-1bdc8c556e7c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.199846 Oct 21 15:06:17.309020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 152/309] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:17 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:18.107726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:18.108543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:18.114460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.114973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.115401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.116088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.116533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.116946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.246440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:18.256031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-89fe1977-9587-4d93-aa62-4514b817d40f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.153225 Oct 21 15:06:18.256386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 158/310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:18 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:18.325260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:18.326058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:18.332898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.333384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.333857 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.334054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:18.334545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.334682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:18.335030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.335454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.340762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.341263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.341694 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.342383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:18.342861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:18.343280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:18.438214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:18.448878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-97171ef9-f3d8-440e-b3c3-ab52ada64c1d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1217 microversion: 2.1 time: 0.127508 Oct 21 15:06:18.449690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 153/311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:18 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:18.512456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:18.520947 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-72f7168f-99ba-4435-ae63-f0d9c78dde39 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.190639 Oct 21 15:06:18.521512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 159/312] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:18 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:19.279490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:19.280231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:19.286380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.286904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.287331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.288016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.288510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.288933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.472255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:19.474061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:19.483281 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.484188 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.484825 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.485871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.486617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.487222 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.497212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:19.505881 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-903830c0-9556-4dae-82f0-09d21df54047 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1363 microversion: 2.1 time: 0.230270 Oct 21 15:06:19.520581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 154/313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:19 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:19.545392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:19.545979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:19.554146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.554691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.555131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.556911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:19.557948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:19.558793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:19.590498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:19.613827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a85930a2-fe82-47ed-b2ad-a717869bad8f tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1217 microversion: 2.1 time: 0.145419 Oct 21 15:06:19.618908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 160/314] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:19 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:19.967167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:19.974832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-60d6157b-6bd2-47af-a068-9c34ec526085 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.434449 Oct 21 15:06:19.975397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 155/315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:19 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:20.547664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:20.547664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:20.547664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.547664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.549169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.549169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.549169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.549169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.640416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:20.641030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:20.643763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:20.648724 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.649204 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.649629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.782943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.782943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.782943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.783727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:20.783727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c62a23d8-93df-4c0e-b206-b50f4145f9d2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1549 microversion: 2.1 time: 0.163028 Oct 21 15:06:20.783727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 161/316] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:20 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:20.784173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:20.784173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-62e0a3fc-68c6-4e14-97df-b1d95fa48030 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1209 microversion: 2.1 time: 0.088078 Oct 21 15:06:20.784173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 156/317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:20 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:20.789856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:20.791153 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:20.798394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:20.799181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:20.803768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.804257 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.804710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.805667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.806115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.806533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.816853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.816853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.816853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.817858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:20.818427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:20.818938 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:20.834573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lazy-loading 'flavor' on Instance uuid 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:21.054195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fc8a1fab-9838-4ffc-9243-4753da1cfb3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261921 Oct 21 15:06:21.054812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 157/318] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:06:20 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:21.060645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:21.061329 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:21.068297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.068894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.069422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.070094 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.070780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.071282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.317534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:21.325560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5ce825fd-3605-4332-a5a5-723921facf61 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.269762 Oct 21 15:06:21.328562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 158/319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:21 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:21.391931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-28394900-8544-4b35-a0f5-bc6d7d99036b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/action" status: 202 len: 0 microversion: 2.20 time: 0.612320 Oct 21 15:06:21.392770 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 162/320] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Oct 21 15:06:20 2022] POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:06:21.401757 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:21.402761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:21.409018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.409512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.409963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.410685 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.411134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.411565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.657763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:21.666851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:21.670246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:21.670766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2d5c3c3c-5cb0-40b8-b4dd-5d5d1330f0fd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.272695 Oct 21 15:06:21.671561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 159/321] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:21 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:21.799617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:21.800313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:21.806842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.807833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.808228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.809066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:21.809645 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:21.810174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:21.900680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:21.906014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:21.910666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bcec75b4-940e-4a1e-a0c2-25ce780ed600 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1209 microversion: 2.1 time: 0.115218 Oct 21 15:06:21.911243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 163/322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:21 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:22.268265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fd0142-c1a4-480c-9c84-114dea2d4a78", "tag": "455afb50-1871-4c92-8e2c-a7238ea79181"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:22.280190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.280770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.281286 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.293250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] Creating event network-changed:455afb50-1871-4c92-8e2c-a7238ea79181 for instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 on hv-cinder-83608 Oct 21 15:06:22.298937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-1b613272-27b5-45f4-aa7e-2fff1afef12d req-db803f4c-f0c4-4e15-a9ba-b73ee960b78e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034293 Oct 21 15:06:22.299812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 160/323] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:06:22.349386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:22.349996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:22.356783 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.357270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.357702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.358395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.358878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.359299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.491104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:22.499919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2b2bda69-a96c-4398-b45f-82c957ac98b2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.154454 Oct 21 15:06:22.500475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 164/324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:22 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:22.697919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:22.698664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:22.704871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.705356 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.705797 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.706495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.706982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.707405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.836601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:22.845063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:22.846507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:22.847744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9d958be7-eb89-4060-806f-1b2e7e34b571 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.154559 Oct 21 15:06:22.848325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 161/325] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:22 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:22.935022 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:22.935774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:22.941965 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.942582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.943052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:22.943753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:22.944208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:22.944633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:23.010038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:23.018409 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5fc16b3c-3f09-4f3b-a6e1-1f2236b4b2b8 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1209 microversion: 2.1 time: 0.087867 Oct 21 15:06:23.019023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 165/326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:22 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:23.524836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:23.525638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:23.533175 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:23.533430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:23.533870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:23.534508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:23.535031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:23.535460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:23.716036 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:23.723950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f5ee2b91-bf50-4616-bbc3-1c096a32827c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.203679 Oct 21 15:06:23.739250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 162/327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:23 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:23.873424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:23.874019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:23.880123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:23.880544 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:23.880970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:23.881705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:23.882152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:23.882595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:24.021417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:24.030297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:24.031757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:24.032897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3a414048-34c2-40ff-a4a0-b39237a394e2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.163537 Oct 21 15:06:24.033438 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 166/328] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:23 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:24.041578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:24.042187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:24.048995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:24.049478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:24.049914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:24.050605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:24.051088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:24.055508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:24.118429 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:24.126121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4338a675-8b5a-44a8-bdcc-e4c3f5d73f9b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1265 microversion: 2.1 time: 0.088739 Oct 21 15:06:24.126700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 163/329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:24 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:24.748978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:24.749877 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:24.756106 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:24.756626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:24.758121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:24.758871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:24.759365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:24.759793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:24.895209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:24.903648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-748dee82-8367-4d1d-9dd1-f63c892efd53 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.158417 Oct 21 15:06:24.904221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 167/330] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:24 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:25.058254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:25.058918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:25.065407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.065882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.066309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:25.067016 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.067464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.067879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:25.148738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:25.149374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:25.156555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.156971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.157400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:25.158086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.158533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.158973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:25.202137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:25.211145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:25.212762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:25.213964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0d2fd2a4-30a7-45d8-a824-ba9bb241118e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.159557 Oct 21 15:06:25.214536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 164/331] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:25 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:25.355152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:25.363347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3b209a25-fa18-4f83-a571-39d09064b4ec tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1265 microversion: 2.1 time: 0.218531 Oct 21 15:06:25.363910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 168/332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:25 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:25.927959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:25.928571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:25.934621 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.935106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.935508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:25.936211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:25.936669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:25.937097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:26.069166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:26.077440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-975afeee-e0b0-4e49-a5bb-5db907096352 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.153527 Oct 21 15:06:26.078005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 165/333] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:25 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:26.240692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:26.241295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:26.243112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:26.243840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=8 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:26.249606 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:26.250093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:26.250526 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:26.251241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:26.251694 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:26.252115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:26.383455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:26.386245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:26.386899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:26.392729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:26.393602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:26.394096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:26.394277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:26.394532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:26.395254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:26.395460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-62ffa203-e05a-4deb-8132-ae1f524e277c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.158689 Oct 21 15:06:26.395710 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:26.396012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 169/334] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:26 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:26.396147 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:26.400491 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:26.459323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:26.467283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-53c92e7c-7f3c-4eea-bce7-befe3aea7bff tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1265 microversion: 2.1 time: 0.084937 Oct 21 15:06:26.467919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 166/335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:26 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:27.099374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:27.105776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:27.106018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.107114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.107590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.108290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.108746 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.109170 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.242303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:27.250316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cc80e866-f22c-49c2-80e7-e93697f08417 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.154839 Oct 21 15:06:27.257666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 170/336] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:27 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:27.421480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:27.422073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:27.428595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.429069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.429500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.430212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.430686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.431136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.503034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:27.503652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:27.509911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.512406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.512406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.512406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:27.512406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:27.514840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:27.578119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:27.586219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:27.587694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:27.588981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6a106759-276d-4a5a-8458-b181705bf3f8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.171815 Oct 21 15:06:27.589533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 167/337] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:27 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:27.595206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:27.603479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9afebb41-06bf-4e3f-b85b-72f0870fd0b0 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1265 microversion: 2.1 time: 0.106420 Oct 21 15:06:27.604039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 171/338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:27 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:28.274221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:28.274344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:28.281347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.281839 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.282267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.283241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.283723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.284144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.437755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:28.454097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-765b989e-8133-4322-ac1a-ca3d317c8aba tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.176690 Oct 21 15:06:28.454097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 168/339] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:28 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:28.615466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:28.616153 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:28.623187 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.624701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.625238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.626041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.626587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.627254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.627555 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:28.628250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:28.634667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.635159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.635761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.636684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:28.637288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:28.638737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:28.732350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:28.759412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6118f12c-009f-4963-aba4-ab5f57bed793 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1271 microversion: 2.1 time: 0.119003 Oct 21 15:06:28.777604 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 169/340] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:28 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:28.808126 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:28.816840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:28.818269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:28.819476 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b353e8e8-2a92-44ed-939e-e646f281d1ef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.208473 Oct 21 15:06:28.820019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 172/341] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:28 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:29.477108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:29.478075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.485447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.486038 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.486593 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.487753 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.488311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.489080 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.626359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:29.636227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-dd9bf118-01f4-44ce-9f7f-249152e9737b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1501 microversion: 2.1 time: 0.164122 Oct 21 15:06:29.637040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 170/342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:29 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:29.661612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50954727-acf5-43fe-ade7-0d9d09a522f7"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:29.664034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.670768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.671248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.671678 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.672364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.672796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.673212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.696257 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] HTTP exception thrown: Cannot 'attach_volume' instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 while it is in vm_state rescued Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Request method failure captured: Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/os-volume_attachments HTTP/1.1 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 74 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrTxd0cVS7SdSiGAMbiivxdPOq2kQeZlcntvOExUBUWe_x_JNWrbP-Ctu6GlGDHioabdBFsahcypxdeAjmPSD1__YhHx9hic97xFbj5UbTqkTy5eo7mpp23yw1Geqdx0SSuHoRaSNMKe_KZajpniRZBV8I6hwO_uwjjn8LL32blLPIw Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:06:29.697912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbced7abbedc497f86e2ea999420b2a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 8632f75445ef4fd3a2f1ebbc2ed87e5b Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {"volumeAttachment": {"volumeId": "50954727-acf5-43fe-ade7-0d9d09a522f7"}} Oct 21 15:06:29.699391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Cannot 'attach_volume' instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 while it is in vm_state rescued Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'server_id': '96d3f579-4139-41ae-a20b-b25f1c6b95a7', 'body': {'volumeAttachment': {'volumeId': '50954727-acf5-43fe-ade7-0d9d09a522f7'}}} Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:06:29.700918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 while it is in vm_state rescued Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:29.705485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 while it is in vm_state rescued Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Returning 409 to user: Cannot 'attach_volume' instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 while it is in vm_state rescued {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-471d6ff1-51bd-4cd4-b13e-3a870e863dbe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041939 Oct 21 15:06:29.706762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 173/343] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:06:29 2022] POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 21 15:06:29.710550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:29.711111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.718101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.718585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.719054 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.719745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.720207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.720635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.789186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:29.789882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.796222 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.796784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.797249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.797920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.798382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.798853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.941066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:29.953151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9573113a-a352-4ff9-87d6-2abbed5d63e4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.166106 Oct 21 15:06:29.953151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 174/344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:29 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:29.961235 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:29.961982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.963800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e4b3f9ee-0881-49d9-93c3-03b863e2141a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/action" status: 202 len: 0 microversion: 2.1 time: 0.256834 Oct 21 15:06:29.967471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 171/345] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:06:29 2022] POST /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:06:29.971254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.971905 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.972507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.973450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.974333 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.974997 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.983428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:29.983910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:29.990225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.990748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.991184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:29.991881 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:29.992348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:29.992752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:30.241538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:30.250162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-22094276-e258-4fba-b946-3609e2670839 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1509 microversion: 2.1 time: 0.278333 Oct 21 15:06:30.253732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 172/346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:29 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:30.260278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:30.273655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:30.277404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9bdb20-ad30-4e69-873e-a17a1b60624a", "tag": "63626514-94d9-47f1-9997-24eb1521f359"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:30.280698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:30.282421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5e0aec37-6bec-445f-909f-0bcfe368e7de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.328810 Oct 21 15:06:30.283263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 175/347] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:29 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:30.290899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:30.291378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:30.291869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:30.304246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] Creating event network-changed:63626514-94d9-47f1-9997-24eb1521f359 for instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a on hv-cinder-83608 Oct 21 15:06:30.311070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-643c8ece-4e1d-4e62-88d4-0ca1d38c04ed req-7a4a5846-6c62-4460-8281-013c74d4c048 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054202 Oct 21 15:06:30.311070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 173/348] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:30.977451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:30.978057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:30.985425 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:30.985923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:30.986349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:30.987063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:30.987527 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:30.987941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:31.125379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:31.133641 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bcd11b0b-bc96-41e7-9cda-36f0f62d2e4e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.160003 Oct 21 15:06:31.135099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 176/349] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:30 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:31.254876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b58f915c-f6ff-4355-ae0e-ca5a1ff3e11a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: .version_select at 0x7fd1e1073280>, body: {"keypair": {"name": "tempest-keypair-146313839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM+Zr2YL+39GQSrB4bEmSIpvu0UQBEiCSVuR/rBBNqsqvFRUE1qBrIfCQIJpIVQEe69mo6XofAowFibMdV2bnohVkVQ3Y5SaJkH6B0rekhnUwtn9Kg5Uy/MFSy4NLlomQ=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:31.273264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-b58f915c-f6ff-4355-ae0e-ca5a1ff3e11a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:06:31.275088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:31.275698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:31.277545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-b58f915c-f6ff-4355-ae0e-ca5a1ff3e11a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:06:31.283363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:31.283852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:31.284444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:31.285303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:31.285759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:31.286179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:31.372588 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b58f915c-f6ff-4355-ae0e-ca5a1ff3e11a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121683 Oct 21 15:06:31.373265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 174/350] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:06:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:31.378411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:31.379068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:31.390487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:31.391088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:31.391602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:31.392385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:31.392988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:31.393481 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:31.547327 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:31.556732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c6332f9a-a1d7-4e33-9efa-ddd951b8f50a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1509 microversion: 2.1 time: 0.285326 Oct 21 15:06:31.571134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 177/351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:31 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:31.612741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:31.620884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:31.622358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:31.623641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b431ee1b-75bb-42bc-9040-b2f6dec486a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.249394 Oct 21 15:06:31.624144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 175/352] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:31 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:32.158193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:32.159741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:32.165127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.165870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.166307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.167038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.167556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.168305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.359917 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:32.368882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2a665fcd-a85d-43eb-be5c-372e2f1afc9e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.214736 Oct 21 15:06:32.369666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 178/353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:32 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:32.588142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:32.589590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:32.598885 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.599484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.599922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.600624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.601084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.601507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.651706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:32.652342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:32.659633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.660307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.661479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.662306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:32.662889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:32.665728 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:32.942672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:32.948985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cf61a033-c9b4-48af-8c28-c8270c6adbbb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1509 microversion: 2.1 time: 0.368339 Oct 21 15:06:32.949672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 176/354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:32 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:32.969621 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:32.978168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:32.988399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:32.988399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b35e0c43-d442-4496-8c01-8a360dbb4515 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.333443 Oct 21 15:06:32.988399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 179/355] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:32 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:33.393603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:33.405750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:33.405750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:33.405750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:33.405750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:33.406434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:33.406434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:33.406434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:33.570180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:33.577236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5e92772e-10e1-4caf-a252-940ab35d72a3 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.188523 Oct 21 15:06:33.577800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 177/356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:33 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:33.973311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:33.973912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:33.980330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:33.981017 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:33.981939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:33.982607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:33.983088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:33.983502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:34.009812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:34.011941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:34.018789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:34.019806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:34.021070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:34.022297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:34.022983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:34.025228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:34.396032 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:34.405500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:34.410227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eb01b4bd-8004-4b8d-85b5-c7754984d6b1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1515 microversion: 2.1 time: 0.440774 Oct 21 15:06:34.410923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 180/357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:33 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1515 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:34.425895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:34.434501 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1949525677", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0eade66-a654-457b-8b3f-068b28484861"}], "security_groups": [{"name": "tempest-securitygroup--1710322683"}], "key_name": "tempest-keypair-146313839", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:34.438402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:34.441763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:34.441763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a5044963-1288-4713-8a00-a542494aa74b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.436116 Oct 21 15:06:34.458979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 178/358] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:34 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:34.552248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] validate_networks() for [('b0eade66-a654-457b-8b3f-068b28484861', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:06:34.601529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:34.602139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:34.608914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:34.609412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:34.609846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:34.610537 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:34.611014 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:34.611435 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:34.847655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:34.856077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-916c4a3b-aa80-4f14-9f83-9dbaa6afcf93 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.258285 Oct 21 15:06:34.857831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 179/359] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:34 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:35.055014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:06:35.055014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:06:35.055014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:06:35.055709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:06:35.055709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:06:35.067177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.068182 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.068723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:35.069964 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.070700 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.071552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:35.090836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:06:35.095646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:06:35.106767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:06:35.109258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:06:35.277808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6578c6ab-7ae2-4ad5-911d-2c279d6d4c38 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.856487 Oct 21 15:06:35.287050 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 181/360] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:06:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:06:35.291951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e61c1a14-6b04-457b-973e-c78146ad5972 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:35.293123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e61c1a14-6b04-457b-973e-c78146ad5972 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:35.360299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e61c1a14-6b04-457b-973e-c78146ad5972 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:35.368141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e61c1a14-6b04-457b-973e-c78146ad5972 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1241 microversion: 2.1 time: 0.081488 Oct 21 15:06:35.369010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 180/361] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:35 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:35.471298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:35.471905 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:35.478141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.478864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.479295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:35.479980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.480428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.480850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:35.620650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:35.629466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:35.630931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:35.632081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a3bc516d-aeb8-47da-9f3c-c57e26a8176b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.164670 Oct 21 15:06:35.632647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 182/362] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:35 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:35.881564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:35.882457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:35.891876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.892605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.893250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:35.894168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:35.895071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:35.895710 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:36.070568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:36.078919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b2c46057-469d-4a3a-a92c-92ce93bd45bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.201550 Oct 21 15:06:36.079474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 181/363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:35 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:36.183152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-46aeecf0-da63-4113-8310-07c0a026a6fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: .version_select at 0x7fd1e10bb040>, body: {"keypair": {"name": "tempest-keypair-200325738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0yIE2a0B+zBBdk2/mCJ3eXqOKkjmGreR9uV3YPmUdMhp9COvT6qV9S32iBYGMQK7OVT3sLSfK2HtQut9E2Ww+riaaoe5ilaOE7UOpQqpVOTJBid7qdKst4jwm1nXFgZA=="}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:36.193921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:36.200368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-46aeecf0-da63-4113-8310-07c0a026a6fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for project bbced7abbedc497f86e2ea999420b2a0. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:06:36.204249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-46aeecf0-da63-4113-8310-07c0a026a6fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for user 8632f75445ef4fd3a2f1ebbc2ed87e5b and project bbced7abbedc497f86e2ea999420b2a0. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:06:36.377564 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-46aeecf0-da63-4113-8310-07c0a026a6fc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198572 Oct 21 15:06:36.378073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 183/364] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:06:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:36.393736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-81a4cbaf-0c18-4151-bc81-2c19678a40d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:36.394342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-81a4cbaf-0c18-4151-bc81-2c19678a40d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:36.455150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-81a4cbaf-0c18-4151-bc81-2c19678a40d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:36.462112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-81a4cbaf-0c18-4151-bc81-2c19678a40d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1241 microversion: 2.1 time: 0.072255 Oct 21 15:06:36.462682 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 182/365] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:36 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:36.657502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:36.658064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:36.664072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:36.664566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:36.665002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:36.665942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:36.666392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:36.666843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:36.824230 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:36.833379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:36.839799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:36.839799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3613dd15-c27f-461b-82f1-5b0c0d3b641b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.182688 Oct 21 15:06:36.839799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 184/366] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:36 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:37.104650 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:37.105398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:37.113041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.113533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.113969 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.114684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.115142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.115572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.284833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:37.293532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-77f75802-3e26-4ead-926c-843481b43141 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.195623 Oct 21 15:06:37.294896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 183/367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:37 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:37.477481 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bdb20-ad30-4e69-873e-a17a1b60624a", "name": "network-vif-plugged", "status": "completed", "tag": "63626514-94d9-47f1-9997-24eb1521f359"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:37.486906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:37.487588 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:37.489708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.490196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.490706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.496062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.496811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.498333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.498333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.498546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.500194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.503494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] Creating event network-vif-plugged:63626514-94d9-47f1-9997-24eb1521f359 for instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a on hv-cinder-83608 Oct 21 15:06:37.509607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-cebb326d-9667-42b5-90f6-356c54b5d4e6 req-e90b3ac3-e04c-437b-8dc0-40efed44bcb9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Oct 21 15:06:37.510279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 185/368] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:37.593219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:37.604773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-17bb2148-1b47-48bf-a128-2f62eceab4cc tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1293 microversion: 2.1 time: 0.123136 Oct 21 15:06:37.615639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 184/369] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:37 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:37.861836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:37.862594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:37.868767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.869261 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.869918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:37.870587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:37.871076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:37.871581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:38.006605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:38.016096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:38.017497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:38.019010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8e738aad-a8d0-4e32-9b39-1b85a7b46101 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.161663 Oct 21 15:06:38.019558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 186/370] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:37 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:38.317172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:38.317920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:38.324087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:38.324770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:38.325998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:38.326956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:38.327786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:38.328460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:38.349783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:38.471148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:38.480952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-018b9fba-3c1a-4fef-832a-917c7e827b5a tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.167647 Oct 21 15:06:38.481607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 185/371] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:38 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:38.634877 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:38.636168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:38.643877 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:38.644278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:38.644876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:38.645523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:38.645986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:38.646408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:38.714807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:38.723356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-460d5a2d-e3aa-4744-9bee-0a4e24f242d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1311 microversion: 2.1 time: 0.097214 Oct 21 15:06:38.723911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 187/372] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:38 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:39.046896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:39.048401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:39.057672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.058573 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.059213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.061562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.062327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.063015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.284836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:39.294919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:39.297299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:39.298950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e60aac7f-7ef8-4e7e-8de6-42f3a93cead7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.257169 Oct 21 15:06:39.300253 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 186/373] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:39 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:39.511459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:39.512608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:39.519079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.519569 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.519994 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.521006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.521607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.522337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.690205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:39.698720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f404b6fc-c211-4435-b83e-fa098a04fbef tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1313 microversion: 2.1 time: 0.191318 Oct 21 15:06:39.699376 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 188/374] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:39 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:39.749080 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:39.755728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:39.767513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.772825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.774003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.775058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:39.775843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:39.776388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:39.864530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:39.875161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-eb813bee-95cb-4b9d-90db-7f2929bd5606 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1299 microversion: 2.1 time: 0.132616 Oct 21 15:06:39.875980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 187/375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:39 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:39.999021 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1673108378", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c23ba3a-efd7-4124-a78d-7daa57f2b1c1"}], "security_groups": [{"name": "tempest-securitygroup--706788787"}], "key_name": "tempest-keypair-200325738", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:40.121577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] validate_networks() for [('5c23ba3a-efd7-4124-a78d-7daa57f2b1c1', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:06:40.331206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:40.332550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:40.339808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.340308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.341441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.342498 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.346235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.346722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.671381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:40.680336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:40.681909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:40.683246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-69b8e32a-199e-4290-be11-ea3d018431f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.357825 Oct 21 15:06:40.683889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 188/376] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:40 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:40.699719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:06:40.701363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:06:40.702102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:06:40.702758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:06:40.703356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:06:40.714158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.714732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.715232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.718687 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.720332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.720944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.723579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:40.724207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:40.730915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.731665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.732304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.733202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.733875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.734485 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.739435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:06:40.743653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Getting quotas for user 8632f75445ef4fd3a2f1ebbc2ed87e5b and project bbced7abbedc497f86e2ea999420b2a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:06:40.755383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:06:40.757797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:06:40.888812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:40.897665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-395cf524-a68d-4aa0-b2fc-c22a22323fc2 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1497 microversion: 2.1 time: 0.177816 Oct 21 15:06:40.898840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 189/377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:40 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:40.906616 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:40.907909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:40.930541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.932507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.933971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.937465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:40.940043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:40.940820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:40.950025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a0f9795f-bcb7-46aa-84ef-b502f6911b33 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.955415 Oct 21 15:06:40.952250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 189/378] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:06:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:06:40.965677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a9f9fcd1-c6e4-4e62-b62a-a55d7c1d3ae1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:40.967410 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a9f9fcd1-c6e4-4e62-b62a-a55d7c1d3ae1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:41.042937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a9f9fcd1-c6e4-4e62-b62a-a55d7c1d3ae1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:41.050281 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a9f9fcd1-c6e4-4e62-b62a-a55d7c1d3ae1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1245 microversion: 2.1 time: 0.090712 Oct 21 15:06:41.060545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 190/379] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:40 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:41.205045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:41.212332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7e7dc1fd-be7f-49d0-9ea8-1774fd1a6cb3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.312309 Oct 21 15:06:41.227235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 190/380] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:40 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:41.430871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ed427f-9de0-4262-97b3-cd20818746e2", "tag": "1e157b05-ce4b-4df9-a87f-0657985dd433"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:41.441612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:41.442224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:41.442579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:41.453928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] Creating event network-changed:1e157b05-ce4b-4df9-a87f-0657985dd433 for instance 54ed427f-9de0-4262-97b3-cd20818746e2 on hv-cinder-83608 Oct 21 15:06:41.459073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-92aa9c58-0136-4a7a-ae05-c34b99838372 req-5cd77299-272f-40ec-ab9b-e0fb5d85c1c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031703 Oct 21 15:06:41.459909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 191/381] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:41.709544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:41.710145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:41.723069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:41.724099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:41.724531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:41.725552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:41.726150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:41.726741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:41.901101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:41.910249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:41.911931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:41.913092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-74b2b280-6d52-4c91-841a-bcdfb7da2007 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.207802 Oct 21 15:06:41.913644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 191/382] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:41 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:42.005457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:42.006039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:42.012288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.020421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.020421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.020421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.020421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.021054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.042899 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:06:42.090004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c8a1bc4a-40c5-46b3-8739-5a4257c73386 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:42.090659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c8a1bc4a-40c5-46b3-8739-5a4257c73386 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:42.149904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c8a1bc4a-40c5-46b3-8739-5a4257c73386 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:42.159353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c8a1bc4a-40c5-46b3-8739-5a4257c73386 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1245 microversion: 2.1 time: 0.072034 Oct 21 15:06:42.161301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 192/383] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:42 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:42.237116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:42.237719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:42.243618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.244104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.244533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.245394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.245857 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.246282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.391291 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-46e4781a-dce4-4716-9d2d-527feedad115 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 204 len: 0 microversion: 2.1 time: 0.389371 Oct 21 15:06:42.391956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 192/384] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:06:41 2022] DELETE /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:06:42.402396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:42.403048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:42.409943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.410517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.411106 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.412073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.412607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.413120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.428119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:42.439003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d51e75e6-763b-4583-942d-b04cf8cbfc12 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.205301 Oct 21 15:06:42.439678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 193/385] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:42 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:42.575482 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:42.579998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8dd9a966-1059-40aa-800d-33a07e24cad4 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.182873 Oct 21 15:06:42.596408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 193/386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:42 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:42.940267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:42.940873 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:42.947181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.947662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.948090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:42.948961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:42.949413 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:42.949829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.111830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.120021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.122270 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.123688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-98995d5d-2810-4a9e-9e4e-4327a6bbc6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.187404 Oct 21 15:06:43.124618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 194/387] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:42 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:43.184073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:43.184907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:43.191031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.191510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.191941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.192623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.193082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.193504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.262161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.270916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-67535a23-da2b-45be-a37a-ec91a80a61d2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1241 microversion: 2.1 time: 0.090533 Oct 21 15:06:43.271497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 194/388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:43 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:43.461479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:43.462108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:43.468116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.468671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.469036 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.469729 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.470214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.470651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.604643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:43.605295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:43.613467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.614868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.615379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.616168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:43.616561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:43.617166 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:43.625275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.639901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c8a14e47-6304-4488-8c2d-d46ac295107a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.182119 Oct 21 15:06:43.641589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 195/389] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:43 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:43.788034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:43.800375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d487fc6d-a3d1-4785-a1eb-e2eb9209b015 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.196674 Oct 21 15:06:43.800375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:43 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:44.150582 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:44.151315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:44.157505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.157991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.158440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.159152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.159610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.160031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.297671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:44.300263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:44.301539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:44.308292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.308907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.308907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.311482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:44.313695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:44.314733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6ee66d5b-ae20-4acd-82a6-59689317a744 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.168401 Oct 21 15:06:44.315243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 196/391] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:44 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:44.326749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.327453 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.327910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.390199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:44.397971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6e6a1745-4cdd-494a-af63-a5b08a12f318 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1241 microversion: 2.1 time: 0.101882 Oct 21 15:06:44.398546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:44 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:44.662712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:44.663324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:44.670379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.670883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.671290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.671978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.672470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.672928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.808568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:44.816500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ecb38b85-5706-4c55-96a9-06b559058f0a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.157577 Oct 21 15:06:44.817207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:44 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:44.836033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:44.836910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:44.844031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.844506 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.844936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.845641 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:44.846204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:44.846648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:44.996740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:45.005451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cdf2a286-5af8-4466-84d3-5e6d6131fc5e tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.188357 Oct 21 15:06:45.006033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:44 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:45.346615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:45.346615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:45.352320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:45.354290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.358063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.363663 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:45.365293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.368155 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.380605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:45.427695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:45.428318 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:45.435103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.435620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.436057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:45.436787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.437248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.437678 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:45.521767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:45.534868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3521375f-48a0-4a7b-9419-9119a724bf05 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1297 microversion: 2.1 time: 0.110832 Oct 21 15:06:45.544725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:45 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:45.560168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:45.568642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:45.570129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:45.571314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-00cd9638-2d79-454c-9cbf-3204d0a6c105 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.235460 Oct 21 15:06:45.585772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 198/396] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:45 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:45.839690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:45.840565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:45.847594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.848125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.848560 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:45.849253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:45.849701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:45.850120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.022480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.030167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:46.031098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:46.032476 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ba12bf90-2bdd-44c9-be8b-481ec617f1f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.196661 Oct 21 15:06:46.033362 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 199/397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:45 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:46.038360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.038946 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.039656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.040823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.041549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.042180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.195825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.205770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bf16ca74-10b3-456f-a7a3-b07234d69e99 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.180221 Oct 21 15:06:46.208996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 199/398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:46 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:46.558434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:46.559105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:46.565079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.565574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.572359 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.572359 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.572359 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.572359 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.586020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:46.597522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:46.598262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:46.605419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.605908 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.607253 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.607822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:46.608494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:46.609105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:46.661395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.675776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0b1178f8-8814-490a-8dcf-4d589b6d1291 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1297 microversion: 2.1 time: 0.121134 Oct 21 15:06:46.677679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 200/399] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:46 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:46.773560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.783237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.784777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:46.785924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a414f55e-4bcf-4b6c-a79b-10cbc0fb96f2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1744 microversion: 2.20 time: 0.192477 Oct 21 15:06:46.786479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 200/400] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:46 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:47.056742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:47.057355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:47.065331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.065824 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.066258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.066986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.067436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.068045 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.206447 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:47.214479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4bd9173e-296f-435c-aa47-9adf2a78c995 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.161616 Oct 21 15:06:47.215182 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 201/401] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:47 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:47.234868 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:47.235981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:47.242105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.242809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.243367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.244084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.244676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.245110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.384041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:47.392725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d04b1207-144d-494f-8b36-c72cd5a1655b tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.164417 Oct 21 15:06:47.393520 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:47 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:47.674571 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "name": "network-vif-plugged", "status": "completed", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:47.684815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.685545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.686163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.701020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:47.706623 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:47.712829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.713538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.714513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.716941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.718935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.719104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] Creating event network-vif-plugged:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:06:47.719993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.729917 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-34cb3f99-0fc9-45b9-acf1-9ef27941dbaa req-b89591ad-216a-498c-a786-8b28e3d5174e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059231 Oct 21 15:06:47.734747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 202/403] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:47.812457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:47.813337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:47.822408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.825986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.826715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.828101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:47.828923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:47.829713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:47.860358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:47.869832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-375b2c78-effd-40c6-9907-2c5a367e3c37 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1297 microversion: 2.1 time: 0.173053 Oct 21 15:06:47.869832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:47 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1297 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:48.083822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:48.093964 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:48.096393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:48.097972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b783f524-b66f-4b9a-b980-7862b26d2762 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.290416 Oct 21 15:06:48.099096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 203/405] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:47 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:06:48.242064 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:48.242708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:48.250577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.250577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.251015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:48.251949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.252636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.253231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:48.270740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:48.417010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:48.417612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:48.433987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.436087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.436968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:48.437697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.443753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.444250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:48.474483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:48.484331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ffd370df-d371-43a6-b925-0fe230a85a94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.246152 Oct 21 15:06:48.485559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:48 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:48.652203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:48.665246 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-79e2385e-1fbf-45a8-90ac-4e62a8e4c8bf tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1503 microversion: 2.1 time: 0.252378 Oct 21 15:06:48.671529 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:48 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:48.899444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:48.899444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:48.902662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.903424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.904093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:48.905411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:48.906338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:48.907039 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.001938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bdb20-ad30-4e69-873e-a17a1b60624a", "name": "network-vif-deleted", "tag": "63626514-94d9-47f1-9997-24eb1521f359"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:49.002931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:49.024041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.024041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.029356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.049435 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c81f687d-c863-4430-96e4-5563b98d54c0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1305 microversion: 2.1 time: 0.158519 Oct 21 15:06:49.066201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] Creating event network-vif-deleted:63626514-94d9-47f1-9997-24eb1521f359 for instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a on hv-cinder-83608 Oct 21 15:06:49.066912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 204/408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:48 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:49.076477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-fdd8b938-4912-403a-be7a-90020fbac90c req-fa7a54de-541e-4a5c-8837-51560a6c6e68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078242 Oct 21 15:06:49.077655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 205/409] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:49.130659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:49.131343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:49.140169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.141015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.141699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.142811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.143565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.144299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.476935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:49.491005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:49.492864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:49.503139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-78796dc4-e247-4442-bfdc-a4abedee0061 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.379022 Oct 21 15:06:49.506142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 205/410] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:49 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:49.528668 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:49.529971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:49.544929 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.548033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.548540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.552610 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.553202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.555114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.702792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:49.704768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:49.718880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.719874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.720575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.723103 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.729511 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.730284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.895606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:49.904506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:49.905069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:49.907053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lazy-loading 'fault' on Instance uuid 4d9bdb20-ad30-4e69-873e-a17a1b60624a {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:49.929334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:49.940725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0079ba51-7705-489c-a9fb-74f4c8524944 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.434800 Oct 21 15:06:49.942337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 206/411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:49 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:49.996641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:50.007950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fbcccdfa-9769-42e3-90bf-cf92e5351767 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1303 microversion: 2.1 time: 0.319005 Oct 21 15:06:50.009183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 206/412] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:49 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:50.078164 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:50.078164 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:50.091635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:50.092666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:50.096730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:50.097701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:50.098398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:50.099080 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:50.260442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:50.277706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-26513205-800f-4205-9791-10ea75e49968 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1303 microversion: 2.1 time: 0.205898 Oct 21 15:06:50.281824 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 207/413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:50 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:50.535596 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:50.536215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:50.546460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:50.546979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:50.547419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:50.561920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:50.562678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:50.566760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:50.877330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:50.877330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:50.885607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:50.885607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cd468b34-3eda-4d3c-b3be-c36051cc63fc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.252941 Oct 21 15:06:50.885607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 207/414] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:50 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:51.002787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:51.002787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:51.002787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:51.002787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.002787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.003906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.003906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.003906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.003906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.048000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=18 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:51.107878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:51.108494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:51.120000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.123387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.126604 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.128285 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.129095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.129745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.176789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.176789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.176789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.176789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lazy-loading 'fault' on Instance uuid 4d9bdb20-ad30-4e69-873e-a17a1b60624a {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:06:51.205147 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:51.215944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c9ede0c4-f31d-4f5b-9716-b51f6a401c31 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.255075 Oct 21 15:06:51.219173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 208/415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:50 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:51.294129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59e9b0ec6e4fee99a93c58f9dcd6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780201e2794a47c294b91f39978cfbf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:51.303408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f3a06a77-1929-49d6-8b24-42920bec4322 tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 200 len: 1303 microversion: 2.1 time: 0.200092 Oct 21 15:06:51.318987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:51.323215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:51.335284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:51 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:51.337341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.337846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.338290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.339034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.339490 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.339920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.596143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:51.609504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2a85f436-b079-42ac-bb5d-d65d840ba973 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.303574 Oct 21 15:06:51.610027 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 209/417] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:51 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:51.892731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:51.893253 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:51.902809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.906111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.906869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:51.911716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:51.911716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:51.911716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.155497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=10 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:52.172027 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ed427f-9de0-4262-97b3-cd20818746e2", "name": "network-vif-plugged", "status": "completed", "tag": "1e157b05-ce4b-4df9-a87f-0657985dd433"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:52.197012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.197504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.197967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.211789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:52.220835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:52.222275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:52.229686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-184c4d76-51f5-4b9f-bcf8-602f050b843a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.341733 Oct 21 15:06:52.230265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 209/418] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:51 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:52.246093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] Creating event network-vif-plugged:1e157b05-ce4b-4df9-a87f-0657985dd433 for instance 54ed427f-9de0-4262-97b3-cd20818746e2 on hv-cinder-83608 Oct 21 15:06:52.248248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:52.254001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:52.265107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-fd791f9a-a5c2-4572-a2ea-1bb4098b55e4 req-df88cf6a-8a7c-4fb0-a93a-71deb43fac89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099105 Oct 21 15:06:52.282361 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.283349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.283977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.284856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.288069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.288862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.289310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 210/419] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:52.356782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:52.361107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] [instance: 4d9bdb20-ad30-4e69-873e-a17a1b60624a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:52.383563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.384066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.384510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.386491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.387013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.395785 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.426754 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] HTTP exception thrown: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Request method failure captured: Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a HTTP/1.1 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrVFtPMaaHsJavHhtyf6h8dhM3qItKAW_Xc_1Ij5p6Kahtwn1oaTDMF4dX_f9zDEUTc0UpcQnWOJ9cQ6L3MT4rdiFdwvIHO7uKOOvWmgVHxlkahBptKcxGMoNcb7oqsS_4QCpXSM8FhoP4Qirm0230XIQynSSahioIEQ8lCijGWc94g Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 780201e2794a47c294b91f39978cfbf4 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:06:52.428464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/780201e2794a47c294b91f39978cfbf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_780201e2794a47c294b91f39978cfbf4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 780201e2794a47c294b91f39978cfbf4 Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesActionsTest-1469373008 Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesActionsTest-1469373008-project Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 6b59e9b0ec6e4fee99a93c58f9dcd6ba Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesActionsTest-1469373008-project Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. Oct 21 15:06:52.429955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '4d9bdb20-ad30-4e69-873e-a17a1b60624a'} Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:06:52.430922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. Oct 21 15:06:52.432111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:06:52.433231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] Returning 404 to user: Instance 4d9bdb20-ad30-4e69-873e-a17a1b60624a could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:06:52.433231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0d4e4eea-7f71-4d34-b3c3-aacf1403182d tempest-VolumesActionsTest-1469373008 tempest-VolumesActionsTest-1469373008-project] 10.222.0.60 "GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a" status: 404 len: 111 microversion: 2.1 time: 0.079890 Oct 21 15:06:52.444432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 211/420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:52 2022] GET /compute/v2.1/servers/4d9bdb20-ad30-4e69-873e-a17a1b60624a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:06:52.635499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:52.636104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:52.662371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.663941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.665897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.667041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:52.669539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:52.670968 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:52.815317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:52.824009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-219c6160-0dd1-4819-b756-1eb85260a9ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.584400 Oct 21 15:06:52.839829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:52 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:53.121429 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:53.141175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-38b3e489-2fd9-432e-b4af-2e49458be5a8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.509448 Oct 21 15:06:53.141769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 212/422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:52 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:53.256440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:53.257323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:53.266585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:53.270400 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:53.271712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:53.272974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:53.274549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:53.276304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:53.771855 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:53.796993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:53.797856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:53.798454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:53.835665 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] Creating event network-changed:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:06:53.861608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-3e775c19-7c87-439d-b376-7bd549a6cc10 req-cb275969-0f43-4de8-9221-d6047eac952c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093313 Oct 21 15:06:53.866151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 213/423] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:06:53.873991 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:53.887697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:53.906880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:53.912702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:53.915175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:53.916370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:53.925820 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:53.928159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:54.277619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:54.362011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:54.377505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:54.378890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cb23ef69-d89e-419e-9a82-370cb65da00c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 1.126496 Oct 21 15:06:54.388408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 211/424] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:53 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:54.398095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:54.398909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:54.408951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:54.412316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:54.412968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:54.413871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:54.427200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:54.427853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:54.430442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:54.446885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ca9798dc-cf31-48f5-b157-47024cc3d34b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1367 microversion: 2.1 time: 0.577208 Oct 21 15:06:54.451667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 214/425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:53 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:54.676882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:54.692690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a57ec5a2-c3d4-4a6d-95e3-9f0b0ef59892 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.298866 Oct 21 15:06:54.693894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 212/426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:54 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:55.412647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:55.430939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:55.436508 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.439183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.439634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.440386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.440842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.441273 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.485775 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:55.499179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:55.501067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.501582 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.502019 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.502765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.503241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.503674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.877852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:55.885727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:55.889295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:55.891790 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:55.893556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-76c5a6d1-1c1a-4e37-9fa5-65f836ca8175 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.491767 Oct 21 15:06:55.894300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 215/427] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:55 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:55.897006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f47ede74-8bc0-412c-86b6-e1beb3902ed7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1557 microversion: 2.1 time: 0.419622 Oct 21 15:06:55.897865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 213/428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:55 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1557 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:55.899675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:55.903552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:55.914354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.916857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.917333 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.918078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.919210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.920112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.927193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:55.927913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:55.934881 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.935691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.936210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:55.936864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:55.937591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:55.938020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:56.058758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-69a75bce-0879-45a5-9c4c-16e0ccda3522 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140978 Oct 21 15:06:56.060056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 214/429] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:06:55 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:06:56.203389 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:56.220066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-51335bfa-5c72-4290-8a38-ec27f39d41bb tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.324284 Oct 21 15:06:56.234811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 216/430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:55 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:56.920099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:56.920735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:56.928359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:56.929093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:56.929877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:56.930847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:56.931896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:56.932392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:57.252003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:57.255203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:57.255649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:06:57.269793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:57.279346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:57.284065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:57.284065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:57.284065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:57.284065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:57.467013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:57.489631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:57.493406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:57.496282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0da09531-bab6-4df8-9f42-ffec4ba3a78c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.580511 Oct 21 15:06:57.498293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 215/431] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:56 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:57.767649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ed427f-9de0-4262-97b3-cd20818746e2", "tag": "1e157b05-ce4b-4df9-a87f-0657985dd433"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:06:57.780281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:57.781199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:57.781868 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:57.824767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] Creating event network-changed:1e157b05-ce4b-4df9-a87f-0657985dd433 for instance 54ed427f-9de0-4262-97b3-cd20818746e2 on hv-cinder-83608 Oct 21 15:06:57.835339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-d1d55f79-0843-4499-aeba-21921bfa85ce req-3efcd1ca-0202-4db7-b270-f52fda0ba91d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071191 Oct 21 15:06:57.836578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 216/432] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:06:57.927112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:57.937536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e571d8a7-ce71-4330-b38c-a52a6d54e8bc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.696101 Oct 21 15:06:57.938111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 217/433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:57 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:06:58.524673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:58.526057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:58.546110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:58.549605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:58.552515 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:58.554116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:58.556101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:58.558603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:58.927571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:58.943617 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:58.962366 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:58.963574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:06:58.968504 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:58.969846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-606bc867-44e3-4594-89f5-bd142044a4dc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.450670 Oct 21 15:06:58.970432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 217/434] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:58 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:06:58.974048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:58.974048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:58.974048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:58.974048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:06:58.974821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:06:58.975456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:06:59.922607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:06:59.936402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c390f3b5-8fe4-4008-b774-e5c3fbdd2cf8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.978010 Oct 21 15:06:59.937972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 218/435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:06:58 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:06:59.995738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:06:59.998084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:00.016714 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:00.019600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:00.024701 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:00.026687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:00.027840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:00.029458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:00.475321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:00.484479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:00.497548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:00.497548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-24b54bdc-6249-4104-852d-f2ff6d20961d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.499574 Oct 21 15:07:00.498236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 218/436] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:06:59 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:01.002427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:01.003063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:01.020415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:01.021114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:01.027392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:01.030421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:01.031142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:01.031786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:01.350862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:01.378189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4e1f5458-9aed-461e-84dc-4963c87f03e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.364842 Oct 21 15:07:01.382738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 219/437] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:00 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:01.529973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:01.529973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:01.549379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:01.550187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:01.552976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:01.554109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:01.557738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:01.567403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:02.187543 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:02.198207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:02.211800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:02.214335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b92bbdfa-a51a-486e-9e7f-4954746f4ffd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.693446 Oct 21 15:07:02.233236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 219/438] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:01 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:02.396181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:02.396985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:02.406118 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:02.406798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:02.407489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:02.408572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:02.409240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:02.410959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:02.442149 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:02.660868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:02.669981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5396f6d9-3381-4a78-a57f-96545d86ffcd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.278512 Oct 21 15:07:02.671740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 220/439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:02 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:03.260548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:03.261187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:03.302085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:03.302583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:03.303050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:03.303764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:03.304224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:03.304646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:03.407185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:03.701940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:03.702617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:03.725013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:03.725520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:03.725955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:03.726687 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:03.727148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:03.732035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:03.792324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:03.803004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:03.804891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:03.806470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d3d00b99-da7a-4630-b156-fdb017a2a228 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.563608 Oct 21 15:07:03.814044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 220/440] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:03 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:04.177620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:04.197288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-125e96ef-96ae-4c83-a777-50641240c791 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.507381 Oct 21 15:07:04.206222 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 221/441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:03 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:04.855565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:04.860540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:04.889105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:04.897376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:04.900426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:04.901203 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:04.904364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:04.906575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:05.233449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:05.234270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:05.263484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:05.263897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:05.264356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:05.267737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:05.268239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:05.268722 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:06.198557 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:06.204002 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:06.217776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:06.219751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:06.221236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7649362b-7681-41f2-88c8-565321761651 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 1.379201 Oct 21 15:07:06.222556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 221/442] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:04 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:06.225510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e1cd9dca-72c3-4047-8442-0208d3c703c2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.988332 Oct 21 15:07:06.226262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 222/443] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:05 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:06.523904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "name": "network-vif-plugged", "status": "completed", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:06.559748 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:06.564448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:06.567513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:06.634088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] Creating event network-vif-plugged:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:07:06.665289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-78ca00ca-8e63-4877-901f-9c08c6cd370e req-c15a7d49-f18c-4087-a651-05033a2b7728 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144874 Oct 21 15:07:06.672158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 223/444] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:07:06.706332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c6653630-6d4d-48e1-8baa-f7ffae988175 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Action: 'create', calling method: .version_select at 0x7fd1e0e9e940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1403498007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIkAYSd48mw3wy2KvZq8z0d5AIyfPJ11Z9dPJJYI0V3Y9TDGXOjKQDfhMECuSerpknHa8e0gP7f1+HjNxyePd810UBlMd0RYhDvBbJQlzmbr2b0Fjk4L1IGIdRO6OQnaw=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:06.802037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-c6653630-6d4d-48e1-8baa-f7ffae988175 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:07:06.835814 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-c6653630-6d4d-48e1-8baa-f7ffae988175 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for user f71ffc3d05d4470fa533cfd6f22184b2 and project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:07:06.944504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:06.946402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:06.961759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:06.962659 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:06.963595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:06.967590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:06.968778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:06.969768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:06.986501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c6653630-6d4d-48e1-8baa-f7ffae988175 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.762325 Oct 21 15:07:06.987874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 222/445] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:07:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:07.042273 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bf5e25b6-0703-4da0-9a44-b98072737b46 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/ips" status: 200 len: 146 microversion: 2.1 time: 0.105317 Oct 21 15:07:07.042908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 224/446] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:07:06 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/ips => generated 146 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:07.249345 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:07.250200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:07.256474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:07.257270 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:07.261522 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:07.262548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:07.263016 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:07.263883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:07.264348 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:07.264780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:07.284661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:07.287960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:07.290384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:07.298131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:07.298912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:07.303173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:08.640532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:08.658266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:08.660042 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:08.661482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-12684e59-07b7-45f7-9aef-30f930d841cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 1.418780 Oct 21 15:07:08.672100 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 223/447] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:07 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:08.693244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:08.706838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6b55e13b-1ef8-4b37-9149-90cd95b1980c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 1.461391 Oct 21 15:07:08.707673 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 225/448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:07 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:09.704738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:09.708274 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:09.724760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:09.727226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:09.737250 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:09.738670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:09.745908 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:09.749339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:09.750328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:09.751939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:09.752576 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:09.755446 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:09.756203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:09.757881 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:09.758558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:09.762991 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:10.317295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:10.336497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c969fee2-9d84-47f2-8f0d-65e1daa98769 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1370 microversion: 2.1 time: 0.605801 Oct 21 15:07:10.337132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 226/449] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:09 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1370 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:10.410175 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:10.419248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:10.420710 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:10.433718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fdd04b91-0f32-4535-86da-504a7d097938 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.728343 Oct 21 15:07:10.435323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 224/450] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:09 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:11.365736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:11.367149 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:11.382775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:11.386233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:11.391577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:11.394949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:11.403388 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:11.414906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:11.478020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:11.480186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:11.494180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:11.495900 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:11.498242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:11.504833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:11.506165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:11.507246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:11.945297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:11.968343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:11.968343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:11.968882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-05d0a27a-593f-48d8-abcc-2e85dd560536 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1739 microversion: 2.20 time: 0.498262 Oct 21 15:07:11.969912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 225/451] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:11 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1739 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:11.984956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba018de5-752f-4400-a569-9e0a296ab2e7"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:11.988152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:12.009201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:12.012988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:12.013874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:12.016153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:12.017098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:12.017745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:12.018363 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:12.018580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c8f06c32-1475-4e04-99ab-87d9689628a6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1564 microversion: 2.1 time: 0.656856 Oct 21 15:07:12.054477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 227/452] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:11 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1564 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:12.070315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:12.070926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:12.095467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:12.096041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:12.096390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:12.097232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:12.097690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:12.098317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:12.385030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-82d700ae-9739-47da-8ff1-4ce247c4a906 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.332341 Oct 21 15:07:12.385030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 228/453] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:07:12 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-interface => generated 285 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:12.954205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2a18db5b-63b7-468f-b175-903ed7e8d47f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974141 Oct 21 15:07:12.967768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 226/454] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:07:11 2022] POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:12.998612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:12.999773 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:13.018505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:13.019474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:13.020177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:13.021135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:13.021872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:13.022529 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:13.546411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:13.558313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:13.563184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:13.566953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dae4bfae-9ebb-48c3-873b-2cbc77dba6ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1721 microversion: 2.20 time: 0.575129 Oct 21 15:07:13.585519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 229/455] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:12 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1721 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:14.600614 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:14.603136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:14.628414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:14.630742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:14.631456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:14.635851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:14.640179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:14.642928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:14.906391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:14.927100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:14.929550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:14.930483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:14.955076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] Creating event network-changed:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:07:14.966060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:14.984163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:14.988187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:14.990087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-56c16dcb-3c25-42f5-8422-66e5d0fd6d92 req-62570fea-90d5-4c62-b3bd-297cd59e93ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089195 Oct 21 15:07:14.991999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b267bbd3-c593-4f53-a3bd-3e541b7649f9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1721 microversion: 2.20 time: 0.396334 Oct 21 15:07:14.993554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 227/456] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:14 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1721 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:14.994342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 230/457] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:16.023530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:16.024251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:16.034305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:16.034877 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:16.035372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:16.042306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:16.042306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:16.042789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:16.520960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:16.542981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:16.546900 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:16.556619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-826013e6-ed52-4423-b2cb-4234e4cdd719 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1721 microversion: 2.20 time: 0.536228 Oct 21 15:07:16.559957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 231/458] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:16 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1721 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:17.586106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:17.587124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:17.589575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=4 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:17.599747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:17.606261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:17.607503 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:17.608181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:17.609075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:17.609811 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:17.610434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:18.059711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:18.075111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:18.076717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:18.080169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-047c26fe-d64e-4f52-94ae-379af4e7272d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1724 microversion: 2.20 time: 0.498037 Oct 21 15:07:18.082675 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 228/459] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:17 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:18.115772 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d36650f6-b5b5-479d-8992-55e23d7f7e14"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:18.120782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:18.131352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:18.133727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:18.134550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:18.135719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:18.136431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:18.138086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:18.184850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "name": "network-vif-unplugged", "status": "completed", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:18.204560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:18.205719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:18.206385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:18.226610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.compute.server_external_events [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] Unable to find a host for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd. Dropping event network-vif-unplugged {{(pid=119358) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 21 15:07:18.228023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-984571a9-f820-411a-9174-7e6f5f5aff94 req-68e95c0e-bac2-4e8f-9fa8-f222887108fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048276 Oct 21 15:07:18.230365 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 229/460] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 21 15:07:19.918967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-08761680-be2e-4319-9212-5b9adca7d2e8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.808064 Oct 21 15:07:19.926881 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 232/461] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Oct 21 15:07:18 2022] POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments => generated 188 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 21 15:07:20.101986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:20.103495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:20.127107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:20.128884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:20.130372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:20.131838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:20.133642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:20.134980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:20.248171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119358) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 21 15:07:20.688298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c6de8c83-d860-4cb0-a1b8-f74372832e20 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/action" status: 202 len: 0 microversion: 2.20 time: 0.590790 Oct 21 15:07:20.688921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 230/462] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Oct 21 15:07:20 2022] POST /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:07:20.697866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:20.698482 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:20.714661 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:20.716772 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:20.718697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:20.719461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:20.719940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:20.720404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:21.275382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:21.290401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:21.292114 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:21.293733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:21.325148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:21.351115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:21.352567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:21.358736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8227ad05-b045-4bf0-b08e-89d5b8014871 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.663810 Oct 21 15:07:21.361773 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 233/463] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:20 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:21.499906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Going to try to stop instance {{(pid=119358) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 21 15:07:21.713662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7bd9413e-97f6-4d46-a606-755981bb32e8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action" status: 202 len: 0 microversion: 2.1 time: 0.441550 Oct 21 15:07:21.713662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 231/464] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:07:21 2022] POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:07:21.721295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:21.722271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:21.741972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:21.745558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:21.747361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:21.748496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:21.750137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:21.752662 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:22.123204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:22.133608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a63d5800-dfd2-4a3c-8ec2-0bc0bf3b69ce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.416798 Oct 21 15:07:22.139389 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 234/465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:21 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:22.397695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:22.399269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:22.409667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:22.410441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:22.415402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:22.416820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:22.417460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:22.418139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:22.644283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:22.664079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:22.674750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:22.694444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-22888193-dab3-43c5-834b-9a55f538b07a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.287235 Oct 21 15:07:22.699475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 232/466] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:22 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:23.166432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:23.168576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:23.195124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:23.195124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:23.195124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:23.195124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:23.195525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:23.195525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:23.416132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:23.427878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6f071906-02b7-4154-9792-bce85535f72b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.265968 Oct 21 15:07:23.435464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 235/467] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:23 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:23.732109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:23.733316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:23.742925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:23.743741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:23.744342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:23.745190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:23.745803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:23.746444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:24.075591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:24.090827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:24.097299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:24.100898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-837765a8-0da5-47d5-a061-285af7c80c79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.371491 Oct 21 15:07:24.122885 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 233/468] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:23 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:24.460660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:24.461389 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:24.468876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:24.477523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:24.477523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:24.477523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:24.477523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:24.478078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:24.508135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:24.920959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:24.930156 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c8d2e9ff-e87f-4359-b6f5-029de841ac1d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.473242 Oct 21 15:07:24.930757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 236/469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:24 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:25.139778 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:25.140306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:25.147826 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:25.148541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:25.148975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:25.149669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:25.151514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:25.152216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:25.322693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:25.332672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:25.334129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:25.335429 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2a11d8b8-173e-4a71-8b36-43ec4e5388de tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.204191 Oct 21 15:07:25.336276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 234/470] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:25 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:25.954201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:25.954850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:25.962420 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:25.963178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:25.963784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:25.964771 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:25.966297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:25.967043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:26.158663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:26.170071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fe6fcdc7-5f8d-4c23-87c5-7f05e9a2804d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.219776 Oct 21 15:07:26.171229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 237/471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:25 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:26.364377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:26.364903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:26.375873 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:26.376820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:26.377544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:26.378452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:26.379048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:26.379472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:26.409394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:26.563860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:26.573397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:26.575643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:26.576903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6e36bc9c-dbc9-48c8-9549-76194a6559d8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.217246 Oct 21 15:07:26.577564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 235/472] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:26 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:27.195610 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:27.196320 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:27.204892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:27.205655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:27.206268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:27.207153 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:27.207786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:27.208383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:27.394414 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:27.409095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f8a4506c-7a03-4771-b44e-5a7823497799 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.217962 Oct 21 15:07:27.418909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 238/473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:27 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:27.608136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:27.608913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:27.616589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:27.617434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:27.618248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:27.619376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:27.620072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:27.620660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:27.795445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:27.806623 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:27.810273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:27.816040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-664ab3e9-e08f-47db-929d-22e36260e56c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.215479 Oct 21 15:07:27.817125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 236/474] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:27 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:28.437595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:28.438335 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:28.444963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:28.445451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:28.446186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:28.447170 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:28.447624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:28.448202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:28.616294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:28.625982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f0e4e53d-3bf6-47cd-a529-df5ed668c610 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.193681 Oct 21 15:07:28.626861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 239/475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:28 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:28.843659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:28.844585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:28.852761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:28.853492 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:28.854022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:28.855007 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:28.856285 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:28.857203 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:29.017956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:29.027991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:29.029684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:29.030890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-02fa8b8b-d4fb-40de-aa78-dcd9187c0e1e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.192757 Oct 21 15:07:29.031621 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 237/476] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:28 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:29.654463 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:29.655672 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:29.663935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=46 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:29.666845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:29.668378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:29.674844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:29.674844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:29.674844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:29.674844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:29.950856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:29.961213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-54c9b669-151c-4f47-b2b2-63e7edf87c66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.314350 Oct 21 15:07:29.961982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 240/477] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:29 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:30.057452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:30.058150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:30.065598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:30.066094 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:30.066507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:30.067252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:30.067703 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:30.068149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:30.221643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:30.233412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:30.233412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:30.234346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bcb6f9a8-4206-452f-a072-42c33fff96bc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.180168 Oct 21 15:07:30.234346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 238/478] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:30 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:30.992575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:30.994204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:31.022709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:31.023699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:31.024504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:31.025629 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:31.026421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:31.028180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:31.260570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:31.260727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:31.261246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:31.268814 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:31.269303 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:31.270188 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:31.270420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:31.270901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:31.271391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:31.276579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d06e3f55-7dec-477d-8dd7-09da72a010bd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.289207 Oct 21 15:07:31.283142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 241/479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:30 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:31.453438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:31.468723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:31.472622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:31.474049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f94a4e2b-8eef-433b-829d-bae68cb900ac tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1750 microversion: 2.20 time: 0.217792 Oct 21 15:07:31.475081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 239/480] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:31 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:32.303481 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:32.304287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:32.318223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:32.318917 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:32.320220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:32.335570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:32.336082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:32.336533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:32.505107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:32.505741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:32.505958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:32.516385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-636ca8d5-9361-4c93-b4dd-df7a06930040 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.217376 Oct 21 15:07:32.517356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 242/481] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:32 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:32.518721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:32.519310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:32.523666 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:32.524595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:32.525280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:32.525923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:32.683831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:32.693420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:32.694941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:32.696320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-40696b53-c75f-4eff-9be1-ca4e617fe19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1752 microversion: 2.20 time: 0.195926 Oct 21 15:07:32.708705 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 240/482] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:32 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:33.540861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:33.541737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:33.557074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:33.558082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:33.558609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:33.559575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:33.560255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:33.560889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:33.725929 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:33.726543 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:33.737131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:33.738143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:33.739531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:33.740597 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:33.741077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:33.741655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:33.805204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:33.836970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-30186bc1-7143-4d75-8304-3832554807c2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.279377 Oct 21 15:07:33.836970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 243/483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:33 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:33.931408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:33.941756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:33.943199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:33.944375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b108c369-eaee-4577-b524-7771dee2cd3e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1752 microversion: 2.20 time: 0.223089 Oct 21 15:07:33.944933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 241/484] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:33 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1752 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:34.842581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:34.843392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:34.854175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:34.855122 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:34.856124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:34.857356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:34.858105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:34.858671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:34.972678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:34.973542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:34.980777 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:34.981374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:34.981906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:34.982988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:34.983812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:34.985795 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:35.138308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:35.147087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e390316b-f961-45a3-a251-dc1081f7e8e0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.309227 Oct 21 15:07:35.163930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 244/485] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:34 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:35.204264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:35.213158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:35.220070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:35.221731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f9e413ad-6d68-4890-ab9c-e2bf45cc5c62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.253544 Oct 21 15:07:35.229903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 242/486] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:34 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:36.172449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:36.173843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:36.180763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:36.181326 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:36.181956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:36.182897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:36.183750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:36.184196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:36.249501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:36.250747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:36.259252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:36.262518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:36.263146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:36.263912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:36.267131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:36.267598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:36.397766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:36.415439 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0de52916-1017-4f06-8f35-bf5daf450fb1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.242075 Oct 21 15:07:36.417451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 245/487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:36 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:36.450653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:36.462206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:36.463658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:36.466276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9f9238af-d022-43c1-9217-74741e4a15e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.221389 Oct 21 15:07:36.493176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 243/488] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:36 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:37.458990 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:37.460197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:37.467304 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:37.467780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:37.468208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:37.468893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:37.469340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:37.469760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:37.495751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:37.501074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:37.504137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:37.504826 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:37.505565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:37.506335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:37.507189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:37.507667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:37.777904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:37.798660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4d087cce-09f9-4816-8f11-a8f70e1202f3 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.354379 Oct 21 15:07:37.800120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 246/489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:37 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:37.806327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:37.816506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:37.819732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:37.821321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5246c22d-500f-4ecd-bbfa-8878f99eaba6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.330349 Oct 21 15:07:37.834157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 244/490] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:37 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:37.874160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-930828712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1403498007", "security_groups": [{"name": "tempest-secgroup-smoke-1507373944"}], "block_device_mapping_v2": [{"uuid": "7ffb775c-f636-4559-b8af-890f92b4f8fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba5ce276-5178-4856-9bdd-bc914a7bfa6c"}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:38.084093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] validate_networks() for [('ba5ce276-5178-4856-9bdd-bc914a7bfa6c', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:07:38.826299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:38.832458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:38.836451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:38.837232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:38.837842 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:38.839251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:38.840095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:38.840685 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:38.846739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:07:38.847313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:07:38.848138 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:07:38.848551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:07:38.848964 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:07:38.865682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:38.865682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:38.865682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:38.865682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:38.866071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:38.866071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:38.911063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:07:38.915906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for user f71ffc3d05d4470fa533cfd6f22184b2 and project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:07:39.047296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:07:39.049699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ffb775c-f636-4559-b8af-890f92b4f8fa',volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:07:39.091553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:39.112235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1b725884-e2db-47f7-bf47-f3665430c342 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.291120 Oct 21 15:07:39.112865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 245/491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:38 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:39.118861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:39.119659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:39.127972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:39.128467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:39.128907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:39.129803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:39.130424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:39.131029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:39.327135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:39.338025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:39.340832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:39.341863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-734fddcc-ff2f-45f6-b731-b4362b034df8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.227872 Oct 21 15:07:39.342691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 246/492] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:39 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:39.732773 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7bff8d7d-01e5-4225-a1a6-643e3d2c330f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.863252 Oct 21 15:07:39.733809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 247/493] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:07:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:07:39.745326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-744f5a03-cd5c-49cf-ab4b-3a41040f5bd4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:39.746502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-744f5a03-cd5c-49cf-ab4b-3a41040f5bd4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:39.872756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-744f5a03-cd5c-49cf-ab4b-3a41040f5bd4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:39.886249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-744f5a03-cd5c-49cf-ab4b-3a41040f5bd4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1094 microversion: 2.1 time: 0.145078 Oct 21 15:07:39.892430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 247/494] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:39 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1094 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:40.141241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:40.141806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:40.154299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:40.156591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:40.163229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:40.164251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:40.164890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:40.167708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:40.386824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:40.386824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:40.386824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:40.386824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:40.387296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:40.387296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:40.387296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:40.387296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:40.515072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:40.524729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b2978600-ef1e-47cd-8a90-298e53fbd6db tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.388059 Oct 21 15:07:40.528812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 248/495] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:40 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:40.790796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:40.790796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:40.791843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:40.791843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-10530a49-ec07-4ea5-bf32-402bdc7765ee tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.278076 Oct 21 15:07:40.791843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 248/496] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:40 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:40.921493 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a1c622b0-4798-41bb-a679-54cea2321eb1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:40.922565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a1c622b0-4798-41bb-a679-54cea2321eb1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:41.069716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a1c622b0-4798-41bb-a679-54cea2321eb1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:41.069716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a1c622b0-4798-41bb-a679-54cea2321eb1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1094 microversion: 2.1 time: 0.105539 Oct 21 15:07:41.069716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 249/497] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:40 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:41.567890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:41.569160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:41.596518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:41.598619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:41.606450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:41.610005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:41.618023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:41.618986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:41.819338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:41.821369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:41.828051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:41.829368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:41.830066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:41.831076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:41.831748 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:41.832378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:41.865970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:41.883655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a76c7205-996c-411d-9c60-0498fb681ff1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.318805 Oct 21 15:07:41.887909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 249/498] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:41 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:42.082000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:42.091207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:42.093334 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:42.099990 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:42.100942 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:42.101692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:42.102143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:42.102894 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:42.103122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:42.103766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:42.104514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7c68087c-65ed-4514-8d43-6d402a96de6d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.289222 Oct 21 15:07:42.104776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:42.107188 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 250/499] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:41 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:42.215744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:42.226407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5bd2dfeb-dff5-4b36-bddb-6d62e15dd922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1144 microversion: 2.1 time: 0.139884 Oct 21 15:07:42.227664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 250/500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:42 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1144 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:42.913276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:42.915343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:42.926256 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:42.929444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:42.931296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:42.932701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:42.935437 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:42.936278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.132910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:43.133591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:43.141116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.141901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.142505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.143412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.144043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.144472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.231914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:43.240213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9a69c8d1-43ee-4d2e-9d66-d5100dcf6a0f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1724 microversion: 2.1 time: 0.332575 Oct 21 15:07:43.240817 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 251/501] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:42 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:43.248903 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:43.249797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:43.256344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.256924 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.257428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.258324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.258967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.263107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.331521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:43.362846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a70bb1cd-508e-403a-896c-8e6db890adee tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1144 microversion: 2.1 time: 0.095320 Oct 21 15:07:43.362846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 252/502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:43 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:43.363227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:43.369020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:43.371140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:43.373844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-db8d62f2-a7d0-4f14-8b27-3d09bb541435 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.244551 Oct 21 15:07:43.374420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 251/503] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:43 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:07:43.612030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:43.612456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:43.618854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.618994 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.619330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.620019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.620471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.621540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.645996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f31fe58a-6b94-4c77-bf7f-226b20df97d5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/ips" status: 200 len: 149 microversion: 2.1 time: 0.037913 Oct 21 15:07:43.646614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 253/504] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:07:43 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:43.658583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1fb98b0-203b-448a-a972-6a24f24d4025"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:43.661087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:43.667595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.668575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.669072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.669875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.670322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.670879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.759781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:43.762298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: POST /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/os-volume_attachments HTTP/1.1 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 74 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:07:43.765026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {"volumeAttachment": {"volumeId": "e1fb98b0-203b-448a-a972-6a24f24d4025"}} Oct 21 15:07:43.766693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'server_id': '54ed427f-9de0-4262-97b3-cd20818746e2', 'body': {'volumeAttachment': {'volumeId': 'e1fb98b0-203b-448a-a972-6a24f24d4025'}}} Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:07:43.767632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:43.769027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 400 to user: Invalid volume: volume e1fb98b0-203b-448a-a972-6a24f24d4025 is already attached to instances: 53221d88-6f22-49de-9589-94759df68635 {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e92071d3-0dff-4208-a86d-1b2784d05218 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115481 Oct 21 15:07:43.772828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 252/505] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:07:43 2022] POST /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:07:43.780984 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:43.781656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:43.789014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.789572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.790082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.790928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:43.791710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:43.792129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:43.828548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:07:43.856406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:44.266333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:44.266983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:44.279265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.280046 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.280542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.281312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.281829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.282308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.282420 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b5bfa0ad-a65b-43dc-b2c5-75ae6fb0ad96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 204 len: 0 microversion: 2.1 time: 0.505663 Oct 21 15:07:44.286571 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 254/506] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:07:43 2022] DELETE /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:07:44.292116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:44.292895 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:44.306998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.314065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.314599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.315378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.315917 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.316356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.515426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.518362 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.523998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9e64b32b-6888-4d92-9ca1-b777729ebdf4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1701 microversion: 2.1 time: 0.264007 Oct 21 15:07:44.524570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 253/507] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:44 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1701 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:44.525942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e7085efc-7567-40e8-bc01-315cf81b8e85 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.238436 Oct 21 15:07:44.529442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 255/508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:44 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:44.529591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:44.530193 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:44.536869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.537544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.549825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.549825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.549825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.549825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.550251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:44.550251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:44.554378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.555069 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.555735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.556614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.557140 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.557633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.629038 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.637924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1cdb786e-5d56-4e78-84fd-5074f85a3aad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1192 microversion: 2.1 time: 0.112340 Oct 21 15:07:44.639683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 254/509] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:44 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:44.643420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:44.649196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.649851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.650287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.674116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Going to try to start instance {{(pid=119358) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 21 15:07:44.719912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.728921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.731150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:44.732716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-27c5e649-1b3e-44ff-a878-b113852f4f3b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.205122 Oct 21 15:07:44.733321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 256/510] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:44 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:44.829780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-17d53477-29f8-40cd-af78-570be61b0e58 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action" status: 202 len: 0 microversion: 2.1 time: 0.189974 Oct 21 15:07:44.830302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 255/511] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:07:44 2022] POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:07:44.838354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:44.839002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:44.845467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.845955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.846390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.847126 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:44.847580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:44.848010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:44.873847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7b7d4679-c58a-44d3-974f-6da60000d7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'create', calling method: .version_select at 0x7fd1e0e24e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1027732448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgH/YJrHMWQBkJP5U5VOZyCx/PMdyoboFRoqYwsv12NOX+C0nn6/wFXhrVO+gG9dcdaEfYJszh5giXcm0K+ZwFUi6/pG6tBefXksMwZaLdbShi7/xkUGiHNq8Ima8DAcQ=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:44.889521 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-7b7d4679-c58a-44d3-974f-6da60000d7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Getting quotas for project a77531edf7224da8847bb5c9813ae7da. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:07:44.893502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-7b7d4679-c58a-44d3-974f-6da60000d7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Getting quotas for user 2f95a367dd3148f1b31363513af8b637 and project a77531edf7224da8847bb5c9813ae7da. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:07:44.978767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7b7d4679-c58a-44d3-974f-6da60000d7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106195 Oct 21 15:07:44.978767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 256/512] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:07:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:45.002133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:45.012794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bce5af10-0e6c-4234-b52e-a4b6e12647f5 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.178076 Oct 21 15:07:45.013483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 257/513] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:44 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:45.091300 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1767435780", "imageRef": "e1231a56-6688-42a6-a926-6e07f6161dbb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1027732448", "networks": [{"uuid": "870578cc-77cc-4374-9ce6-c401715d7564"}]}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:45.144719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] validate_networks() for [('870578cc-77cc-4374-9ce6-c401715d7564', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:07:45.551806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:45.553107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:45.562605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.567153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:07:45.568112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:07:45.568799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:07:45.569367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:07:45.570146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:07:45.573562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.576547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.578766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.580893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.581514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.591070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.594289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.594758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.595783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.596392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.596972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.616719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Getting quotas for project a77531edf7224da8847bb5c9813ae7da. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:07:45.622990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Getting quotas for user 2f95a367dd3148f1b31363513af8b637 and project a77531edf7224da8847bb5c9813ae7da. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:07:45.635338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:07:45.639807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1231a56-6688-42a6-a926-6e07f6161dbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:07:45.757023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:45.765587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1ae7d0f7-dea9-4586-a84c-405a22acd118 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.218238 Oct 21 15:07:45.766729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 258/514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:45 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:45.774431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:45.777118 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:45.782219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.782756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.783040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fde25988-1525-4609-a3aa-6c1b3b0fd8c8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696725 Oct 21 15:07:45.783196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.784027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 257/515] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:07:45.784156 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.784372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.785052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.789443 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:45.791784 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:45.799354 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.800101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.800785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.801731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:45.802378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:45.802836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:45.943421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:45.955459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-31608495-2abb-490f-925f-b2928c5b8922 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1192 microversion: 2.1 time: 0.187494 Oct 21 15:07:45.956292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 259/516] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:45 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1192 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:45.962524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3e883c79-d74a-458e-bb52-d42269a65b76 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:45.963404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3e883c79-d74a-458e-bb52-d42269a65b76 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:46.125276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3e883c79-d74a-458e-bb52-d42269a65b76 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:46.133270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3e883c79-d74a-458e-bb52-d42269a65b76 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1259 microversion: 2.1 time: 0.175596 Oct 21 15:07:46.134836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 260/517] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:45 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:46.140408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:46.141267 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:46.148234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:46.148732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:46.149173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:46.150076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:46.150535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:46.151006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:46.205427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:46.217482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:46.219386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:46.223109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-01e8a916-82b6-465e-9cbf-ca649282f5b5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.434819 Oct 21 15:07:46.223109 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 258/518] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:45 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:46.321151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:46.334001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1fa6ba0a-2ac5-411a-9180-cc4f20a04ea6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.197915 Oct 21 15:07:46.334593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 261/519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:46 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:46.792459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:46.794385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:46.802578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:46.803234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:46.803733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:46.804631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:46.805291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:46.805713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:46.993560 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:46.994398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:47.006737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.008464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.009997 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.014664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.015325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.015872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.020249 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.030458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-dcbb0da1-9e37-43b2-a085-8c3a5d8f2df7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.242928 Oct 21 15:07:47.031257 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 259/520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:46 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:47.099587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.110274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dc2631d8-32d1-4291-9fb9-8103a3df5df1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1192 microversion: 2.1 time: 0.126293 Oct 21 15:07:47.110890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 262/521] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:46 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1192 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:47.158553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:47.159188 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:47.165638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.166380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.166846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.167546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.168822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.169870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.243518 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.246402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:47.247258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:47.258117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-899db4f9-979d-4394-8ea7-ea93f1b37cff tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1263 microversion: 2.1 time: 0.103351 Oct 21 15:07:47.258445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.258723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 260/522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:47 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1263 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:47.259542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.260135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.261012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.262357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.262972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.358917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:47.359575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:47.362880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:47.370312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.371532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.372482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.377035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:47.377035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:47.377035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:47.419253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.435136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.437180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.440108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dbc78edf-291c-4870-a03c-e88ea94c6dc3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.196480 Oct 21 15:07:47.455549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 263/523] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:47 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:47.562384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:47.581162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f6addbc9-805b-4ea7-9437-ee85ae37e8a2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.227077 Oct 21 15:07:47.581774 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 261/524] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:47 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:48.054918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:48.056140 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:48.063080 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.063558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.063987 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.064750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.065379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.065619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.133396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:48.134005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:48.141812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.143760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.143760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.143760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.144044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.144422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.223546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.227071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.233009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b18dd94f-474a-420b-b62f-2df04f45b533 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1192 microversion: 2.1 time: 0.103256 Oct 21 15:07:48.233493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 262/525] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:48 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:48.235306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ab344c6f-ad47-4a87-ba69-1615662d579e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.184227 Oct 21 15:07:48.235863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 264/526] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:48 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:48.284620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:48.285148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:48.291846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.292330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.293379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.294387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.294877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.295306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.360076 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.367876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b11b4695-c30a-42d2-bd57-2464a7af165c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1263 microversion: 2.1 time: 0.087163 Oct 21 15:07:48.368438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 263/527] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:48 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:48.466883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:48.467485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:48.473533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.474012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.474477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.475197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.475652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.476075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.606237 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.608302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:48.608924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:48.615171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.615648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.616078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.616778 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:48.616887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.617229 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:48.617712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:48.618543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.619761 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e29e0c00-65b0-4031-8291-d801e35d9084 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.156942 Oct 21 15:07:48.620383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 265/528] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:48 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:48.752590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:48.762676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b8aed7f9-0f98-4f15-bca9-2a4803e775d1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.159439 Oct 21 15:07:48.768352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 264/529] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:48 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:49.256228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:49.256842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:49.258653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:49.259259 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:49.259373 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:49.266831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.267125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.267407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.267847 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.267984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.268457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.268635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.269195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.269316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.269506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.269896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.271095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.363958 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.369613 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1e77f03f-3ab5-4a5c-87d8-6fb90d55c12f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1192 microversion: 2.1 time: 0.117249 Oct 21 15:07:49.370389 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 266/530] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:49 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1192 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:49.395439 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:49.400041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:49.403066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.403552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.403981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.404676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.405121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.405542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.513638 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.521944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-725e726e-ec50-4a8d-9f82-714fee6aff6a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1263 microversion: 2.1 time: 0.131267 Oct 21 15:07:49.522561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 267/531] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:49 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1263 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:49.531346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.557740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0faf24f6-bbda-4bb9-a105-7e94883be70e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.303054 Oct 21 15:07:49.559911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 265/532] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:49 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:49.646592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:49.647291 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:49.653959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.654515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.655042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.655797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.656316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.656827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.787355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:49.788213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:49.794897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.795610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.796221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.797100 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:49.797553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:49.798319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:49.798795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.807368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.809452 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.810621 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-895817fb-1d50-481a-b0bb-449b8d23ea27 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.168438 Oct 21 15:07:49.811186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 268/533] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:49 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:49.941146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:49.951060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4c5f5537-8090-4ae1-820a-8be2a6a92391 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.167489 Oct 21 15:07:49.961159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 266/534] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:49 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:50.399229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:50.399856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:50.417549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.418574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.419536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.421743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.422218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.422675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.506399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:50.515185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f2d375d8-2c1e-4497-bd8e-6bf38f8f00bb tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1210 microversion: 2.1 time: 0.119543 Oct 21 15:07:50.516396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 269/535] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:50 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:50.545636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:50.548486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:50.554855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.555568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.556126 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.556829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.557433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.559228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.583688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:50.584691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:50.594806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.595583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.607786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.608814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.609457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.610231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.636402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:50.646149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-87356340-66c7-4a05-9af4-03ab6c045609 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1311 microversion: 2.1 time: 0.105188 Oct 21 15:07:50.646955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 267/536] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:50 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:50.756938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:50.765821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9be6c31d-f89c-4e8b-af2c-925c2877a0f9 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1681 microversion: 2.1 time: 0.187095 Oct 21 15:07:50.766391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 270/537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:50 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:50.837322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:50.838030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:50.845438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.845988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.846489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.847298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.847801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.848288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.984673 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:50.985343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:50.993630 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.995057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.995057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:50.996715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:50.997677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:50.998267 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.000043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.003356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:51.010395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.012876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.014305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ec1a6403-56d2-41c9-acaa-7c4781033de9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.180878 Oct 21 15:07:51.020655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 268/538] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:50 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:51.176167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.192896 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5b90e786-34d4-43b8-8d1d-ae43ebec7566 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.219031 Oct 21 15:07:51.193468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 271/539] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:50 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:51.321462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ed427f-9de0-4262-97b3-cd20818746e2", "name": "network-vif-deleted", "tag": "1e157b05-ce4b-4df9-a87f-0657985dd433"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:51.363767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.363767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.363767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.363767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] Creating event network-vif-deleted:1e157b05-ce4b-4df9-a87f-0657985dd433 for instance 54ed427f-9de0-4262-97b3-cd20818746e2 on hv-cinder-83608 Oct 21 15:07:51.369071 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-f88090ee-13a6-4746-af25-94bb1cc6c5ba req-829fcd25-5e15-485b-afd0-351ea8673f79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051290 Oct 21 15:07:51.370132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 269/540] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:07:51.547798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:51.549064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:51.555619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.556354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.556899 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.557675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.558345 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.559134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.636025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.643779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-76753b7e-5138-4693-840e-205aaf881c75 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1210 microversion: 2.1 time: 0.105780 Oct 21 15:07:51.644566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 272/541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:51 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:51.679562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:51.685436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:51.689387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.690119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.690552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.691288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.691735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.692159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.761093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.765273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:51.771351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8b5c1b44-c46f-44bd-ac82-7a6b6230652a tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1319 microversion: 2.1 time: 0.097522 Oct 21 15:07:51.771920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 270/542] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:51 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1319 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:51.792519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:51.793858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:51.805825 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.806424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.806958 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.807836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:51.808699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:51.809411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:51.922437 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:51.936288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7b8438db-715e-4ad9-976c-22be43b9f7d7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1326 microversion: 2.1 time: 0.147834 Oct 21 15:07:51.942336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 273/543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:51 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:52.042707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:52.043771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:52.052139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.052948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.053614 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.054589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.055319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.059516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.231629 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:52.238381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:52.253151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.255332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.256853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.260177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.260745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.262575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.480700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:52.492601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:52.494083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:52.495342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e2ae95d3-d438-4969-8968-9a97b17385b4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.458054 Oct 21 15:07:52.519803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 271/544] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:52 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:52.576785 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:52.594579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a8157e16-2366-4e0b-9874-3e8eb123f138 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1710 microversion: 2.1 time: 0.382137 Oct 21 15:07:52.606814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 274/545] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:52 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1710 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:52.672026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:52.673158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:52.682794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.684168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.684742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.685558 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.686035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.686767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.797083 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:52.798352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:52.805294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.806289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.815089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:52.815089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:52.815089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:52.815089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.069488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.081495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-46d77e52-0fcc-48f5-9519-a1d80567caf3 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1278 microversion: 2.1 time: 0.416241 Oct 21 15:07:53.083932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 272/546] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:52 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1278 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:53.128965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:53.129594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:53.148312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.183714 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.185636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.188275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.188958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.192377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.263666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.267791 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.268526 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.276480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.279377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid 54ed427f-9de0-4262-97b3-cd20818746e2 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:07:53.289299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-11bfb13c-d9fd-43f1-a74b-d3e9e86e178c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1371 microversion: 2.1 time: 0.496940 Oct 21 15:07:53.302789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 275/547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:52 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1371 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:53.339201 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.349468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5063dd29-f3fe-48a9-b73a-fff440c71239 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 200 len: 1331 microversion: 2.1 time: 0.232087 Oct 21 15:07:53.350404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 273/548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:53 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 1331 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:53.535996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:53.535996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:53.541633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.542146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.543105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.543809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.544264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.544677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.624045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:53.627725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:53.636226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.638860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.639665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.640762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:53.641454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:53.642332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:53.779904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.807394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.827419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:53.830328 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eeb3d635-8273-42fe-9402-fa1150f49d88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.300914 Oct 21 15:07:53.831926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 276/549] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:53 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:53.993313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:54.012362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-38c55ab7-1df8-4431-babd-ead661c7249c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1714 microversion: 2.1 time: 0.390710 Oct 21 15:07:54.015469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 274/550] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:53 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1714 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:54.114963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:54.120075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:54.128329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:54.132258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.134509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.140121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.142223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.144242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.148806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.173157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5259dd-4225-4de2-9782-ef2b6373a42f", "tag": "3dafda79-f594-42a3-9926-a914f06e3f6f"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:54.200339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.200958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.201401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.234255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] Creating event network-changed:3dafda79-f594-42a3-9926-a914f06e3f6f for instance ac5259dd-4225-4de2-9782-ef2b6373a42f on hv-cinder-83608 Oct 21 15:07:54.264470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-92526eb4-f21d-4d78-8a84-7683bc14afec req-4e1bafab-9b75-4fa6-af38-ac565bf976bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096634 Oct 21 15:07:54.266917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 275/551] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:54.318275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:54.322541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:54.343422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.344613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.351978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.353268 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.353992 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.354676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.476427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:54.489179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-601a7fcb-3a89-42a1-be93-d0e914e865b8 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.383665 Oct 21 15:07:54.501969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 277/552] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:54 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:54.503401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:54.508532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:54.519341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.519341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.519341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.519657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.520122 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.520546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.566796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 HTTP/1.1 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:07:54.568483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:07:54.570009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '54ed427f-9de0-4262-97b3-cd20818746e2'} Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:07:54.570954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:07:54.572448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:07:54.591181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:07:54.591181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d8a5286f-cac3-46ba-b424-db756eb4c395 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 404 len: 111 microversion: 2.1 time: 0.088390 Oct 21 15:07:54.591181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 278/553] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:54 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:07:54.598218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8c21918c-a19e-481f-b35a-8925ae158d5d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '.version_select at 0x7fd1e0e4e4c0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:54.646215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:54.655613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-750879dc-5921-4e7d-b685-2f0d8e2477be tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.342585 Oct 21 15:07:54.675760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 276/554] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:54 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:54.716860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8c21918c-a19e-481f-b35a-8925ae158d5d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146313839" status: 202 len: 0 microversion: 2.1 time: 0.122452 Oct 21 15:07:54.719735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 279/555] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Oct 21 15:07:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146313839 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:07:54.863084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:54.864153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:54.884432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.887579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.888230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:54.889042 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:54.895163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:54.899882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:55.097091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:55.110205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:55.112667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:55.113934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-37669050-66c6-4a79-b760-b2b65602f6d4 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.254679 Oct 21 15:07:55.114644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 277/556] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:54 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:55.516475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:55.517086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:55.523300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:55.523767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:55.524200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:55.524893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:55.525343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:55.525762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:55.682956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:55.685819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:55.695028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:55.696667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=12 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:55.702275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:55.703034 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:55.703632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:55.704508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:55.705127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:55.705695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:55.756321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:55.767035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4c51fabc-9b3f-4791-a890-47fe50ba5ea0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.255027 Oct 21 15:07:55.768214 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 280/557] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:55 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:55.919907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:55.930009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6269c307-1271-49e8-a7bb-d93f491976aa tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.250957 Oct 21 15:07:55.931956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 278/558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:55 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:56.060834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:56.061320 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:56.067301 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.067780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.068206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.068889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.069337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.069758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.133721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=10 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:07:56.139835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:56.140444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:56.147244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.148037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.148818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.161505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.162174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.162808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.233314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'services' on Instance uuid 53221d88-6f22-49de-9589-94759df68635 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:07:56.322476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:56.336471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:56.341105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:56.342726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4ba30eba-3ffb-44d3-9ce9-2156d0ba2e07 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.207256 Oct 21 15:07:56.343827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 279/559] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:56 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:56.348662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:07:56.360738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.365011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.365011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.379665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] Creating event network-changed:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:07:56.386205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-cbea66d8-d1bc-4d14-8323-f66b7a25fabc req-46e54fdd-1bb6-4471-8d80-1d9677a2b97d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040860 Oct 21 15:07:56.387988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 280/560] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:56.575660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6173c62a-fc69-41a3-b3f6-5c0bb1c99a47 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments/e1fb98b0-203b-448a-a972-6a24f24d4025" status: 202 len: 0 microversion: 2.1 time: 0.519599 Oct 21 15:07:56.576361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 281/561] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:07:56 2022] DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments/e1fb98b0-203b-448a-a972-6a24f24d4025 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:07:56.585764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:56.588240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:56.597207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.597848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.598418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.599266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.599828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.600360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.642746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0e8ef2c6-e9ad-40b7-b5cc-846785be66c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061370 Oct 21 15:07:56.643462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 281/562] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:07:56 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:56.791252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:56.791252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:56.798393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.798909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.799334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.800029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.800479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.800897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.972510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:56.973466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:56.985639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.986545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.987096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:56.988583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:56.988861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:56.989606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:56.990250 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:57.004732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7e79bdc7-c25c-41fd-9e85-7fbd92ea319b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.218832 Oct 21 15:07:57.006455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 282/563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:56 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:57.148971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:57.157458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c5212e03-c323-4cc3-8354-dbb0b879c9ec tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.202023 Oct 21 15:07:57.157957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 282/564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:56 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:57.369478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:57.370107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:57.376796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:57.377272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:57.377801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:57.378483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:57.378957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:57.379380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:57.526014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:57.535431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:57.537037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:57.538209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e19e3eef-1671-438d-bd8f-9c1569973011 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.172774 Oct 21 15:07:57.538781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 283/565] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:57 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:57.656061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:57.658217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:57.664807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:57.665325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:57.665790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:57.666847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:57.667342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:57.668480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:57.707092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7232f996-c629-4e48-9a2f-30a1d1ff9883 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055483 Oct 21 15:07:57.713622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 283/566] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:07:57 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:58.030671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:58.031347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:58.037286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.037764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.038196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.038913 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.039369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.039793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.180890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:58.189983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0240eefb-7119-41c2-82a2-ef9131b2c29c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.163935 Oct 21 15:07:58.191752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:58.193026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:58.201645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.202507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.203211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.204151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.204851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.205370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 284/567] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:58 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:58.205754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.346460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:58.355815 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-785251fd-199e-4308-9e40-ec554a79e4a7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.168197 Oct 21 15:07:58.356711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 284/568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:58 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:58.565820 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:58.566355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:58.572549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.573084 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.573527 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.575196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.575639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.576072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.720669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:58.723226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:58.728530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:58.730914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.731515 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.732151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.733112 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:58.733629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:58.734063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:58.739854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:58.741314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:58.742484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-81b0fb75-29f4-4b95-964f-4b682d2b66ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.180908 Oct 21 15:07:58.748439 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 285/569] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:58 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:07:58.774884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9a9ad46b-5fd2-4754-b16c-b572049dc738 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058066 Oct 21 15:07:58.775841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 285/570] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:07:58 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:07:59.213280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:59.215611 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:59.222288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.222803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.223234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.223926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.224637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.225244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.379323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:59.379951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:59.386377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.388292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.388902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.389768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.390378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.390898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.402274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:59.410388 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fd35326a-4815-4ca6-a737-4b188f6f1883 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.200968 Oct 21 15:07:59.411299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 286/571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:59 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:07:59.563864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:59.571606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-61ac3049-7c81-4a5f-8339-9f6d5cf03578 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.196153 Oct 21 15:07:59.572178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 286/572] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:07:59 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:07:59.770873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:59.771687 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:59.779070 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.779905 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.780734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.781886 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.782565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.783390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.821033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:07:59.823211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:07:59.831052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.831279 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.831550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.832251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:07:59.832701 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:07:59.833118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:07:59.868545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fe01d3f3-1f0e-49f0-82fd-edf2a5cef6ad tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051639 Oct 21 15:07:59.869261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 287/573] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:07:59 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:07:59.931834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:59.943235 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:59.944690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:07:59.946496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b0df180c-d7c9-4b38-a380-e3991a4fde60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.179912 Oct 21 15:07:59.947415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 287/574] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:07:59 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:00.017732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "name": "network-vif-plugged", "status": "completed", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:00.036173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.036173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.036173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.047525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] Creating event network-vif-plugged:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:08:00.053196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-8ec5f8cd-8fc9-4dee-a91d-922c8ce6e92e req-f2ab450d-4b0a-4502-85f7-7f0931126eb7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Oct 21 15:08:00.054359 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 288/575] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:00.442270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:00.443783 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:00.452113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.452963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.453742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.454990 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.455745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.456438 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.595234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:00.595936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:00.603081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.603870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.604312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.605110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.605860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.606224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.608583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:00.610701 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:00.612063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:00.616839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8615d842-d262-43cf-b0c1-17947c24cef2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.179362 Oct 21 15:08:00.627846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 288/576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:00 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:00.758527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:00.767801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-aec2b055-3821-445e-b123-469dcbfadc96 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.178016 Oct 21 15:08:00.768554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 289/577] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:00 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:00.881417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:00.883708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:00.890743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.891217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.891658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.892346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.892804 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.893271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.925090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f6b66d99-04f6-4b45-bef0-85d4228264be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047897 Oct 21 15:08:00.930254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 289/578] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:00 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:00.972406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:00.972925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:00.978916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.979397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.979827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:00.981047 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:00.981585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:00.982523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:01.032383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5594a1b4-40b4-4a3a-87ce-25aa7adffec8"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:01.034777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:01.041044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:01.041787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:01.042220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:01.043663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:01.044269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:01.044692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:01.146403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:01.158971 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:01.160833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:01.162270 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6a238451-320b-4461-9c7c-66b38aa186ca tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.193834 Oct 21 15:08:01.162966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 290/579] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:00 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:01.642212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:01.643283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:01.649629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:01.650120 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:01.650555 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:01.651272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:01.651727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:01.652312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.026671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:02.033433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-58d491c2-c80d-4250-953b-377269e304d0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.395185 Oct 21 15:08:02.034084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 291/580] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:01 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:02.038557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:02.039180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:02.045910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.046418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.046892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.050924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.050924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.050924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.194207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:02.205829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a2779cf9-4e89-4989-8641-1a3301707af7 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.168050 Oct 21 15:08:02.208355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 292/581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:02 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:02.215980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:02.218530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:02.224985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.225765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.226370 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.227266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.227993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.228564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.270025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-46108946-e3ec-44b7-9a16-42eb9a992cc3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060238 Oct 21 15:08:02.270768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 293/582] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:02 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:02.279760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:02.280472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:02.287216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.287843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.288343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.289110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:02.289636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:02.290124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:02.442515 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:02.452465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:02.458776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:02.458776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-127d1a29-f9c2-40e8-a825-73f60b25ca79 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.183336 Oct 21 15:08:02.458776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 294/583] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:02 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:03.062069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:03.062828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:03.069591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.070149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.070590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.071312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.071767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.072191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.210437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:03.221918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8b047412-b6d7-4dc4-b9f9-cbb554322e54 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.164468 Oct 21 15:08:03.222578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 295/584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:03 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:03.229021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:03.234342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:03.236425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.236903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.237332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.238023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.238474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.238927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.373495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:03.381202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7f6634c8-d722-4296-8a7f-009ed8f00cef tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.155839 Oct 21 15:08:03.388132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 296/585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:03 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:03.388132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:03.388861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:03.394657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.395153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.395591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.396372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.396833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.397255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.427140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-377006f3-0cd2-439a-b5a4-42eae4c92dd3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Oct 21 15:08:03.427694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 297/586] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:03 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:03.481829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:03.482436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:03.488401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.488888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.489326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.490040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:03.490496 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:03.490982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:03.615920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:03.624522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:03.625997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:03.627213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bd35d614-007d-43db-a313-7ba5457f126a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.149776 Oct 21 15:08:03.627806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 298/587] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:03 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:08:04.245279 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:04.245889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:04.252667 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.253189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.253616 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.254310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.254892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.255223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.387848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:04.395450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-358d90e3-1c8c-4930-92f5-32f2a9e2460f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.154006 Oct 21 15:08:04.396011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 299/588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:04 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:04.404067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:04.404741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:04.410386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.410916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.411356 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.412044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.412502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.412931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.544426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:04.552166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-202af549-cf88-4e93-8a99-c62a327b3332 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.151862 Oct 21 15:08:04.552736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 300/589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:04 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:04.557294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:04.560012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:04.565567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.566046 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.566480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.567183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.567630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.568044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.598221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fc554f1b-f019-4665-b1e2-adee8a2eb745 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Oct 21 15:08:04.598804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 301/590] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:04 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:04.651350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:04.651948 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:04.658157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.658728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.659163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.659846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:04.660296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:04.660717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:04.787237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:04.796563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:04.798001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:04.799221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-22110291-04c6-4a28-94db-219c75d08421 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.151509 Oct 21 15:08:04.799785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 302/591] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:04 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:08:05.417477 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:05.418111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:05.424800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.425281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.425719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.426414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.426896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.427320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.560049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:05.567668 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-945146ef-a18f-471b-96dd-976d49e98072 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.154293 Oct 21 15:08:05.568230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 303/592] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:05 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:05.575810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:05.576416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:05.582355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.582871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.583301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.583985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.584460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.584848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.711991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:05.720263 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b6070c08-b82e-45cc-a407-855fef339c03 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.148660 Oct 21 15:08:05.720826 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 304/593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:05 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:05.725448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:05.727691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:05.733168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.733646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.734076 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.734782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.735236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.735653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.760525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:05.765860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0625028f-ebfb-4451-bffe-bbee897d12c0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Oct 21 15:08:05.773744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 305/594] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:05 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:05.824774 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:05.825938 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:05.832111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.832583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.833012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.833686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:05.834131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:05.834548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:05.961449 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:05.970713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:05.972542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:05.973699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1cec5fd6-0167-4d5d-835d-4880f4497c3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.152691 Oct 21 15:08:05.974584 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 306/595] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:05 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:08:06.590503 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:06.591183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:06.598309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.598833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.599270 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.599957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.600414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.600836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.731333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:06.740436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a9854229-3962-4dc7-a40d-81e1e4d98aa9 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.153722 Oct 21 15:08:06.741008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 307/596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:06 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:06.745499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:06.746128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:06.751702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.752177 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.752607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.753314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.753766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.754185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.899276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:06.908069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-752d4aa1-81e8-43d5-9750-3e8c8d9ed350 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.165987 Oct 21 15:08:06.908671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 308/597] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:06 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:06.913534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:06.915975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:06.926150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.926150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.926150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.926150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:06.926563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:06.926563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:06.956968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-110c328a-a959-4a1e-b0c6-46d224221006 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Oct 21 15:08:06.957538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 309/598] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:06 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:06.998887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:06.999499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:07.002313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:07.005627 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.006110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.006545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.007262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.007713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.008135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.141438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:07.149973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:07.151455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:07.152594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cc975826-61f0-4791-b3e0-9bc6f7e85c99 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.157714 Oct 21 15:08:07.153149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 310/599] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:06 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:08:07.762976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:07.769836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:07.771225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.771708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.772140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.772831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.773285 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.773707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.791123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d376cd2c-235e-473d-bafe-e15f2753e6fe tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.766159 Oct 21 15:08:07.795354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 290/600] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:08:01 2022] POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 194 bytes in 6768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:07.905115 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:07.912824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1ffb7476-8728-41c6-ba74-8db6860a06f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.153686 Oct 21 15:08:07.913382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 311/601] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:07 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:07.933017 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:07.933825 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:07.940607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.941086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.941516 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.942194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.942656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.943082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.970505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:07.972739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:07.979101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.979813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.983655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:07.983655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:07.983655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:07.983655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:08.014512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7bb45c72-15d4-4f5a-ba21-8ffc0ba991b4 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048695 Oct 21 15:08:08.015369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 312/602] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:07 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:08.087445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:08.096670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b5b8dfbf-5c52-4c43-beb6-142dedd7dc80 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.167908 Oct 21 15:08:08.097638 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 291/603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:07 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:08.178131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:08.178828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:08.184861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:08.185366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:08.185827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:08.186524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:08.187012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:08.187437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:08.319127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:08.328434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:08.329872 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:08.331119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7492e2b5-4a24-4a3c-a3cc-60a1d2626759 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.156862 Oct 21 15:08:08.331966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 313/604] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:08 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:08.936020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:08.937416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:08.944117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:08.944600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:08.945035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:08.948108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:08.948108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:08.948108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.027572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:09.029778 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:09.036809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.037455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.038048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.039069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.039771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.040190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.080039 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-86459cfa-2f81-49ec-bd4f-282824dce293 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056674 Oct 21 15:08:09.080725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 314/605] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:08:09 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:08:09.103717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.116951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-02c1f87b-fe11-44f7-9dcd-d51c9ec1264e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.181496 Oct 21 15:08:09.116951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 292/606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:08 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:09.121644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:09.122494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:09.129434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.129930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.130369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.131102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.131558 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.131997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.161164 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:09.161654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:09.167823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.168380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.168717 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.169408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.170354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.171430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.200715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:08:09.292539 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.301634 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1661a0d4-a33c-4c47-aa91-cf6482ef7fbc tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.185762 Oct 21 15:08:09.302202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 315/607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:09 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:09.356467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:09.357158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:09.363798 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.364092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.364521 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.365205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.365694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.366054 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.508597 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.517564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.519031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.520169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-656ad779-32b8-491f-9933-3ffa70d4bd0b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.167747 Oct 21 15:08:09.520718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 316/608] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:09 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:08:09.564890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4ca97e2b-c63c-4f83-856a-2b6125798e6c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 204 len: 0 microversion: 2.1 time: 0.407246 Oct 21 15:08:09.565674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 293/609] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:08:09 2022] DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:08:09.573899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:09.574662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:09.581062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.581536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.581963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.582673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:09.583128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:09.583546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:09.718505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:09.726312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0d17a20d-396a-42ed-bfcd-8ad65932a4ef tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1680 microversion: 2.1 time: 0.156318 Oct 21 15:08:09.726893 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 317/610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:09 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:10.140857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:10.141594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:10.148112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.148589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.154277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.154277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.154277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.154277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.290525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.299569 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9fa51850-82ca-48c3-bf92-5bb57faf6233 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.163697 Oct 21 15:08:10.300141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 294/611] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:10 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:10.325152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:10.325770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:10.333312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.333791 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.334223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.334952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.335404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.337728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.466299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.474919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a985e3a4-09cc-4b27-bfc1-5c227c00506b tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.153718 Oct 21 15:08:10.475752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 318/612] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:10 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:10.547445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:10.548077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:10.553922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.554400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.554864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.555766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.556176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.567323 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.691799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.700480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.702471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.703664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-93de1962-c49a-479c-864a-2631924b8331 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1808 microversion: 2.20 time: 0.161276 Oct 21 15:08:10.704216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 295/613] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:10 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:10.749378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:10.749982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:10.756342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.756808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.757234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.757917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:10.758380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:10.759055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:10.884123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:10.892376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4de0328e-5104-41bc-aede-c74116e189a0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1680 microversion: 2.1 time: 0.146981 Oct 21 15:08:10.892961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 319/614] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:10 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:11.323677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:11.324279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:11.331833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.332212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.332644 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.333322 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.333775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.334195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.470873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:11.478514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e7fc2427-3883-4d5c-ba9e-e69bba9d6a69 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.158685 Oct 21 15:08:11.479107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 296/615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:11 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:11.497313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:11.497961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:11.504583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.505067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.505500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.506189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.506651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.507095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.638453 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:11.648546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a65f5f04-ee14-4dfe-942a-c33e39b1d918 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.154966 Oct 21 15:08:11.649127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 320/616] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:11 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:11.728939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:11.729561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:11.735674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.736157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.740743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.740743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.740743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.740743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.872579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:11.882226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:11.883733 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:11.884897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b591d424-0774-4b4e-b5fd-8ac96c14798c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1795 microversion: 2.20 time: 0.159878 Oct 21 15:08:11.885460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 297/617] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:08:11 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:08:11.916149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:11.917290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:11.923647 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.924292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.924906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:11.925674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:11.926239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:11.926796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.069624 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:12.079450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ce98d58d-26e7-4606-9851-7bf1e9c58be7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1680 microversion: 2.1 time: 0.167439 Oct 21 15:08:12.080106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 321/618] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:11 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:12.501573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:12.502348 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:12.509020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:12.509526 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:12.510016 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.510849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:12.511387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:12.511876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.645806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:12.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8603706d-968d-41d4-92ba-4348e4580aaa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.156229 Oct 21 15:08:12.654827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 298/619] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:12 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:12.674318 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:12.674957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:12.681781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:12.682267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:12.682731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.683408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:12.683843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:12.684345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.712029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:12.828148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:12.835935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-80414f10-9e75-487f-8c0f-262e389624f3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.166293 Oct 21 15:08:12.836501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 322/620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:12 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:12.957752 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53221d88-6f22-49de-9589-94759df68635", "name": "network-vif-deleted", "tag": "8b960579-3161-44a9-932e-f96e86acfcad"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:12.967395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:12.967680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:12.967926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:12.979141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] Creating event network-vif-deleted:8b960579-3161-44a9-932e-f96e86acfcad for instance 53221d88-6f22-49de-9589-94759df68635 on hv-cinder-83608 Oct 21 15:08:12.984814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-69463425-8f1d-4107-be4f-0b3a8760f058 req-fee2e280-e488-4e8f-8004-8a7d63dc64b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031093 Oct 21 15:08:12.985555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 299/621] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:13.103832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:13.104770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:13.113459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.114254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.114982 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:13.116060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.116727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.117350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:13.185844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:13.194215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ba476089-0aca-4370-90fa-12c8199fea96 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1612 microversion: 2.1 time: 0.094739 Oct 21 15:08:13.195009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 323/622] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:13 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1612 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:13.679394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:13.680103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:13.687974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.688675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.689453 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:13.690010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.690470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.691108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:13.829233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:13.836985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b0eaefde-8ba9-4446-822e-30800047fdce tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.162902 Oct 21 15:08:13.837546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 300/623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:13 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:13.860374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:13.864066 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:13.867843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.868326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.868755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:13.869454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:13.869944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:13.870362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:14.012744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:14.021288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-120cf681-9963-4ebe-b061-a92c02c1ac22 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.165869 Oct 21 15:08:14.022187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 324/624] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:13 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:14.227221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:14.227221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:14.227221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:14.227221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:14.227585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:14.227585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:14.227756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:14.228109 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:14.292555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:14.301025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-56f8265e-df9d-40e1-8368-dc2820cc2f3e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1612 microversion: 2.1 time: 0.087530 Oct 21 15:08:14.301588 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 301/625] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:14 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:14.860169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:14.860774 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:14.866924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:14.867401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:14.867835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:14.868525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:14.868981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:14.869403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.004520 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:15.012158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e5e38ac6-7001-4c0b-9e70-a58ac3a9b19c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.156683 Oct 21 15:08:15.012718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 325/626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:14 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:15.046296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:15.046940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:15.053531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:15.054066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:15.054566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.055360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:15.055811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:15.056300 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.188110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:15.195802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-68c4895f-3896-4399-be56-0adf078fde27 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.154645 Oct 21 15:08:15.196367 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 302/627] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:15 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:15.324218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:15.324830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:15.331730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:15.332207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:15.332638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.333314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:15.333764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:15.334182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.365406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:15.365892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:15.366324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:15.366792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid 53221d88-6f22-49de-9589-94759df68635 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:08:15.407176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:15.414826 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9e32e409-b28e-40d4-b289-d6b1eb1d2c54 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1330 microversion: 2.1 time: 0.094610 Oct 21 15:08:15.415396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 326/628] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:15 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:16.034697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:16.035272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:16.041675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.042419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.042892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.043583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.044040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.044467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.049218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:16.186885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:16.194857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-286d1ad0-f0bf-40ab-901a-f1000d73e4ab tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.163986 Oct 21 15:08:16.210093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 303/629] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:16 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:16.220178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:16.220788 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:16.227474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.227954 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.228410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.229267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.229807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.230170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.366800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:16.374328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6acb5bb4-32c4-4e75-a932-ae19380d05b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.159418 Oct 21 15:08:16.375050 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 327/630] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:16 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:16.438395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:16.439030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:16.445526 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.446005 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.446427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.447147 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.447696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.448121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.478224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:16.478765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:16.479199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:16.479631 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid 53221d88-6f22-49de-9589-94759df68635 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:08:16.519629 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:16.527546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fffa69cf-0ca7-4fa1-b3cf-e1d6ab401d35 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 200 len: 1330 microversion: 2.1 time: 0.093214 Oct 21 15:08:16.528103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 304/631] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:16 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:17.217981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:17.219195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:17.226350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.227843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.227843 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.228366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.228996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.230474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.238224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "name": "network-vif-plugged", "status": "completed", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:17.251697 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.255878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.255878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.268489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] Creating event network-vif-plugged:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:08:17.273885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-20dc0573-8471-42ec-865f-f58f1447a065 req-d73e9cbf-cc23-427a-9b01-46955b8a9f25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040454 Oct 21 15:08:17.274810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 305/632] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:17.404315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:17.404315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:17.411293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.411792 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.414389 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.415382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.415959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.416431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.445501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:17.455162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5e1b56b3-090d-4510-b73f-fe9f9122440f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.241531 Oct 21 15:08:17.457215 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 328/633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:17 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:17.528289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:17.530882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:17.536880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.537376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.542448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.542448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.542448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.542448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.566218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'flavor' on Instance uuid e6689dc5-351a-4f46-b892-2788f4f5793a {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:08:17.583331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:17.600637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-05463ec1-dc13-440a-8480-549021d1a0cf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.207186 Oct 21 15:08:17.615030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 306/634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:17 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:17.622624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:17.624428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:17.632454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.632454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.632454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.633277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:17.633954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:17.634672 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:17.650157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 HTTP/1.1 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:08:17.651981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:08:17.653729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '53221d88-6f22-49de-9589-94759df68635'} Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:08:17.655085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:08:17.656499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:17.657876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:08:17.658147 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-031d9b76-950c-4dc6-9f22-a5eaf5c1134f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 404 len: 111 microversion: 2.1 time: 0.041115 Oct 21 15:08:17.658843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 307/635] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:17 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:08:17.677441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-68530886-c401-401b-82d3-7724e0e66755 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '.version_select at 0x7fd1e0db8c10>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:17.788375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-68530886-c401-401b-82d3-7724e0e66755 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123397004" status: 202 len: 0 microversion: 2.1 time: 0.116801 Oct 21 15:08:17.790543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 308/636] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Oct 21 15:08:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123397004 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:08:17.995944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d2db65a5-4553-47f0-bc14-b6d3638dcb44 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/action" status: 200 len: 32 microversion: 2.1 time: 0.467623 Oct 21 15:08:17.995944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 329/637] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:08:17 2022] POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 21 15:08:18.004081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:18.005137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:18.014793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.015376 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.015822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.016400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.016844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.017566 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.272406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:18.281374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-371f8478-a1d9-4b07-8704-a717e6528096 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.282401 Oct 21 15:08:18.281945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 309/638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:17 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:18.486358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:18.487102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:18.494330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.494847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.495281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.495973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.496432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.496856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.628799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:18.629615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:18.637401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.637812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.638363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.638991 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:18.639594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:18.640332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:18.751176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:18.759586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-df356ea3-75d0-4e92-9d0c-7ca246c97b18 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.277703 Oct 21 15:08:18.760184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 330/639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:18 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:18.811028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e5fe8367-9752-4659-89f4-86d72dbafaf5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: .version_select at 0x7fd1e0e00430>, body: {"keypair": {"name": "tempest-keypair-1206734038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEt1J1L8zXxM41O7enGDFhnKqDFq6WcA4taqLGnpXj8bifXcU1NNWMIIh2NkKJeCygniVz8sTSLySVDB9SlKwy4OLYldYvV9OqtdeHvcg+qMTtzAwcWkgzpfTsJbfTN4lw=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:18.831376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-e5fe8367-9752-4659-89f4-86d72dbafaf5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:08:18.835914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-e5fe8367-9752-4659-89f4-86d72dbafaf5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:08:18.857467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:18.867415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-62691eed-ce8d-4712-a584-9d3ec49b5fd6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1359 microversion: 2.1 time: 0.242554 Oct 21 15:08:18.868650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 310/640] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:18 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:18.930167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e5fe8367-9752-4659-89f4-86d72dbafaf5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123692 Oct 21 15:08:18.930914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 331/641] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:08:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:19.296009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5259dd-4225-4de2-9782-ef2b6373a42f", "name": "network-vif-plugged", "status": "completed", "tag": "3dafda79-f594-42a3-9926-a914f06e3f6f"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:19.305368 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:19.305867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:19.320972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.320972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.320972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.320972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.321292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.321292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.321530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.321530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.321530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.332893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] Creating event network-vif-plugged:3dafda79-f594-42a3-9926-a914f06e3f6f for instance ac5259dd-4225-4de2-9782-ef2b6373a42f on hv-cinder-83608 Oct 21 15:08:19.337969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-fb4d4184-8da3-4816-a213-f4bf4f55f30f req-f7ec3a10-2257-4e09-b584-c29beb549165 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047138 Oct 21 15:08:19.338892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 311/642] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:19.485113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:19.493755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-04d58818-7764-480c-a435-0933ef9e0dfc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.192240 Oct 21 15:08:19.498682 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 332/643] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:19 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:19.783547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:19.784364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:19.797355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.799982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.799982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.802999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.803489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.803961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.893591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:19.894420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:19.900654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.901140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.901611 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:19.902311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:19.902790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:19.903211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.039011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.054014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3c7c4278-a1c3-48b2-8953-33b32333711d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.274659 Oct 21 15:08:20.054936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 312/644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:19 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:20.105541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.114218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5d792783-73ce-41a9-bccf-b8a1e5a1aaab tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1548 microversion: 2.1 time: 0.225174 Oct 21 15:08:20.114970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 333/645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:19 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1548 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:20.138574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:20.139709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:20.145838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.146533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.146992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.147691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.148148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.148723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.306942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.315727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-39b20d4f-e9ae-431b-9555-a3a9012f4707 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1548 microversion: 2.1 time: 0.181322 Oct 21 15:08:20.316299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 313/646] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:20 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:20.339355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:20.344482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.345247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Searching by: {'deleted': False, 'project_id': 'a77531edf7224da8847bb5c9813ae7da'} {{(pid=119358) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 21 15:08:20.352805 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.353356 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.353737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.354531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.355011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.355589 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.453904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.multi_cell_list [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119358) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 21 15:08:20.518572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:20.519327 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:20.526167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.526739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.543245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.543245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.543245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.543245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.557323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9fed4c4c-a821-4200-8954-ba6c49d8c4b1 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221787 Oct 21 15:08:20.566712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 334/647] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Oct 21 15:08:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:20.572672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:20.573289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:20.580018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.580505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.581000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.581713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:20.582160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:20.582926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:20.806812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.815369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d3e36f9f-0bb7-4a6f-9837-6194ec532443 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.301615 Oct 21 15:08:20.816001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 314/648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:20 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:20.817442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:20.825323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-20bd92f9-eb30-45fb-8c78-45f4f684dadd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1548 microversion: 2.1 time: 0.257334 Oct 21 15:08:20.826159 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 335/649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:20 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1548 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:21.078233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:21.078901 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:21.086263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:21.086796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:21.087243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:21.087947 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:21.088411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:21.088844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:21.529553 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:21.538054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-271d2bf4-89f1-4006-8f3a-fd739900a786 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.464656 Oct 21 15:08:21.538667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 315/650] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:21 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:21.851468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:21.852070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:21.858908 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:21.860332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:21.860332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:21.860645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:21.860880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:21.861295 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.017009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:22.026685 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-facab88b-9a67-4549-982b-ebe08828d4bd tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.178903 Oct 21 15:08:22.026900 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746902577", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0eade66-a654-457b-8b3f-068b28484861"}], "security_groups": [{"name": "tempest-securitygroup--436248819"}], "key_name": "tempest-keypair-1206734038", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:22.027963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 336/651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:21 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:22.141943 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] validate_networks() for [('b0eade66-a654-457b-8b3f-068b28484861', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:08:22.547552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:08:22.548196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:08:22.548629 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:08:22.549109 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:08:22.549589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:08:22.561935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.563012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.565317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:22.565943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:22.570848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.572355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.579252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.579397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.579509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.579590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.579590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.579590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.579590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.579871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.597123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:08:22.601885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:08:22.604360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:22.611943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:22.615278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:08:22.617179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:08:22.735897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:22.743887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c34c2f04-fcc5-4922-91bb-a82b108958c1 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1266 microversion: 2.1 time: 0.183764 Oct 21 15:08:22.744575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 337/652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:22 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:22.774264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d0a506ce-0b5f-41f1-b6e9-5d70ab579146 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.751799 Oct 21 15:08:22.774953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 316/653] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:08:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:08:22.787612 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d747440f-7868-474d-8fd1-889d4722727f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:22.788487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d747440f-7868-474d-8fd1-889d4722727f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:22.850378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d747440f-7868-474d-8fd1-889d4722727f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:22.859241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d747440f-7868-474d-8fd1-889d4722727f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1241 microversion: 2.1 time: 0.075995 Oct 21 15:08:22.859829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 338/654] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:22 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:22.901275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d63e227f-8981-429f-b5fc-3e4dd47b56e7"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:22.904133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:22.912333 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.912966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.913565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:22.914467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:22.921412 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:22.921412 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.061629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:23.062146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:23.069116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.069593 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.070025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.070733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.071187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.071633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.209432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:23.218142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7db56994-2991-4eb3-9e90-a6ada3ff02a3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.160894 Oct 21 15:08:23.218726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 339/655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:23 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:23.651458 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ef5817bf-106b-46a7-b0df-5ecaa4a362f2 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754107 Oct 21 15:08:23.652229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 317/656] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:08:22 2022] POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:23.767117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:23.773327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:23.773620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.774233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.774691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.776068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.776529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.776954 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.891310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:23.896814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:23.903759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.904838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.909271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.916236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:23.917949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.918737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.919129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.925401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-671f986b-db7f-4b83-a7e1-1688ab5547b0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1454 microversion: 2.1 time: 0.162391 Oct 21 15:08:23.939475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 340/657] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:23 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:23.949914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:23.950528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:23.957895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.958375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.958835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.959545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:23.959994 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:23.960406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:23.997470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:24.006951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-04e5fca5-155c-4ba4-8704-b7749694dd9c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1245 microversion: 2.1 time: 0.120105 Oct 21 15:08:24.011090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 318/658] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:23 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:24.102660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:24.110922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c070eef6-346e-40dc-a715-27b903390520 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1454 microversion: 2.1 time: 0.165295 Oct 21 15:08:24.111428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 341/659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:23 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:24.244548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:24.245268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:24.252309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:24.252893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:24.253405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:24.254178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:24.254739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:24.255173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:24.455524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:24.464458 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4acd73c0-4f1c-4032-980d-c4b686adf90f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.223761 Oct 21 15:08:24.465033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 319/660] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:24 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:25.029517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:25.030482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:25.037224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:25.037692 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:25.038121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:25.038842 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:25.039298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:25.039991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:25.104002 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:25.112264 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1fb8c0d2-e24d-4f18-9aac-0bed4cf7cb66 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1293 microversion: 2.1 time: 0.086839 Oct 21 15:08:25.112862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 342/661] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:25 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:25.493753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:25.493753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:25.497502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:25.498423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:25.499266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:25.500222 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:25.500765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:25.501344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:25.641340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:25.649885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b71f083d-98b6-477c-8061-1b28d93fa4f6 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.164073 Oct 21 15:08:25.650451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 320/662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:25 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:26.135875 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:26.136415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:26.143465 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:26.143951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:26.144374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:26.145066 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:26.145517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:26.145935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:26.208602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:26.216989 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-95e12159-817e-48a7-867d-704eb3226012 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1299 microversion: 2.1 time: 0.084408 Oct 21 15:08:26.217850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 343/663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:26 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:26.674776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:26.675173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:26.682997 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:26.683564 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:26.683978 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:26.689936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:26.689936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:26.689936 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:26.831541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:26.836644 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:26.844470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2d4e9ef2-253f-46eb-8ba8-47312563d66c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.174439 Oct 21 15:08:26.845513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 321/664] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:26 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:27.091168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5259dd-4225-4de2-9782-ef2b6373a42f", "tag": "3dafda79-f594-42a3-9926-a914f06e3f6f"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:27.101455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:27.101940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:27.102552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:27.113736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] Creating event network-changed:3dafda79-f594-42a3-9926-a914f06e3f6f for instance ac5259dd-4225-4de2-9782-ef2b6373a42f on hv-cinder-83608 Oct 21 15:08:27.119788 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-ca853d33-9a6c-401f-be5a-26af5e83f5b2 req-008f6107-18eb-4d8a-8f73-f141d6d48e45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Oct 21 15:08:27.120405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 344/665] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:27.243307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:27.243833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:27.251151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:27.251651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:27.252087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:27.253572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:27.254209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:27.254662 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:27.398548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:27.407275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d719182f-a1fa-4e5c-a4e8-508f6d7c4e41 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.169822 Oct 21 15:08:27.408319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 322/666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:27 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:27.869945 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:27.870655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:27.879538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:27.880030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:27.880468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:27.881176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:27.881646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:27.882062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:28.036487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:28.045698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5a5f1aa1-21a0-47eb-ad61-ed50b381046f tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.179623 Oct 21 15:08:28.050196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 345/667] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:27 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:28.431500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:28.432119 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:28.439311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:28.439793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:28.440227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:28.440923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:28.441377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:28.441797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:28.575599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:28.584071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6db3f6f2-1f36-47ac-9ffa-1cf0701ff0be tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.156481 Oct 21 15:08:28.584728 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 323/668] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:28 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:29.069145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:29.069747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:29.076181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:29.076663 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:29.077091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:29.077775 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:29.078225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:29.078660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:29.139812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb330ad8-3230-4a73-8657-b7ad0f3d7875", "tag": "07561374-f0cb-41d8-88e2-2decd05a6e6e"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:29.149382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:29.149859 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:29.150290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:29.162720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] Creating event network-changed:07561374-f0cb-41d8-88e2-2decd05a6e6e for instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 on hv-cinder-83608 Oct 21 15:08:29.168008 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-9460a188-449e-4332-b073-c1830cce3a5f req-221f569d-86cd-4034-9c87-e80efd2ed284 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Oct 21 15:08:29.168597 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 324/669] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:29.207676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:29.215792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a03bedfd-51e3-4098-820a-6552d6f635f9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.150446 Oct 21 15:08:29.216345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 346/670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:29 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:29.607743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:29.608373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:29.614969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:29.615458 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:29.615893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:29.616586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:29.617040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:29.617468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:29.747417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:29.755133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-18614352-df98-495d-9aaa-1f948756a731 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.152183 Oct 21 15:08:29.755702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 325/671] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:29 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:30.239322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:30.239891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:30.246323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:30.246846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:30.247280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:30.247974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:30.248422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:30.248841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:30.392897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:30.395184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:30.401945 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d83079db-38cf-41e5-9ab4-3d3f100e9f31 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.166536 Oct 21 15:08:30.402544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 347/672] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:30 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:30.777400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:30.778001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:30.784845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:30.785333 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:30.785768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:30.786466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:30.786944 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:30.787370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:30.923360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:30.931123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2d5d0d35-8927-49b4-8821-ae7c8a640428 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.157625 Oct 21 15:08:30.931700 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 326/673] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:30 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:31.426569 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:31.427196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:31.433689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:31.434162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:31.434592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:31.435816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:31.436309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:31.436724 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:31.578302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:31.587043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4182d9e4-92fb-4e06-b174-fef1ba95884a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.164537 Oct 21 15:08:31.590232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 348/674] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:31 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:31.955088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:31.955699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:31.961720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:31.962201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:31.962660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:31.963357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:31.963809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:31.964233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:32.092311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:32.099985 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-be57f107-a71a-4d74-9aae-7b60882656c7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.149558 Oct 21 15:08:32.110197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 327/675] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:31 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:32.331135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:32.331748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:32.337691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:32.338266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:32.338734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:32.339425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:32.339881 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:32.340306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:32.470812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:32.479185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-69081b33-6d5a-4987-8f4d-1239bfb2a059 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1594 microversion: 2.1 time: 0.151910 Oct 21 15:08:32.479748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 349/676] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:32 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:32.610573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:32.611288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:32.613228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:32.614011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=6 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:32.618622 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:32.619142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:32.619572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:32.620263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:32.620709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:32.621129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:32.756555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:32.765498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-39b2cc48-5f0c-4149-9294-b0d4558d9bab tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.158772 Oct 21 15:08:32.766253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 328/677] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:32 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:33.122089 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:33.123437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:33.125352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=6 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:33.130280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:33.130810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:33.131251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:33.131952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:33.132500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:33.132937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:33.209572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb330ad8-3230-4a73-8657-b7ad0f3d7875", "name": "network-vif-plugged", "status": "completed", "tag": "07561374-f0cb-41d8-88e2-2decd05a6e6e"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:33.223547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:33.224029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:33.224688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:33.237224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] Creating event network-vif-plugged:07561374-f0cb-41d8-88e2-2decd05a6e6e for instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 on hv-cinder-83608 Oct 21 15:08:33.242471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-a0689701-7ddb-4142-97fb-c57978190ba3 req-b4182a43-87bd-4dfa-aae1-2113befbd4e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Oct 21 15:08:33.243286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 329/678] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:33.383698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:33.391724 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8a611738-cf07-4e4a-9850-28df5f16f43d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.273503 Oct 21 15:08:33.392295 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 350/679] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:33 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:33.790097 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:33.790947 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:33.797677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:33.798164 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:33.798605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:33.799325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:33.799796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:33.800208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:33.985670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:33.994567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-96af9a7d-a4a3-494a-a84d-0d1e7a9cf2e3 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.208806 Oct 21 15:08:33.995172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 330/680] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:33 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:34.415090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:34.415854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:34.424175 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:34.430926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:34.430926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:34.430926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:34.430926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:34.431746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:34.814049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:34.821863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6b57a21e-7124-47cd-b4c6-9fa4bd338a7a tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1366 microversion: 2.1 time: 0.410628 Oct 21 15:08:34.822447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 351/681] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:34 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:34.985305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:34.996299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:34.997189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:34.998304 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:35.011450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] Creating event network-changed:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:08:35.017739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-95d6ced4-14eb-4d7f-8fd4-7c0716ddf23f req-d3aabb21-ba64-4f27-9861-8f5d6391f48c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037020 Oct 21 15:08:35.018613 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 331/682] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:35.019635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:35.020315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:35.026916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:35.027401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:35.027934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:35.028526 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:35.028998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:35.029479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:35.190494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:35.198786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3fbfe00f-069f-44ab-8473-a0452987a32d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.183287 Oct 21 15:08:35.199346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 352/683] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:35 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:35.846044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:35.846824 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:35.854580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:35.855106 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:35.855543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:35.856548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:35.857071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:35.857998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:36.003879 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:36.011851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d39725f8-6871-4981-93a7-231852f088b5 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1556 microversion: 2.1 time: 0.171230 Oct 21 15:08:36.012509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 332/684] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:35 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:36.035200 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:36.035735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:36.039478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:36.043149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:36.043642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:36.044081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:36.045008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:36.045735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:36.046081 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:36.132920 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1781f1d8-ab61-4847-a268-896d3135a1d1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101321 Oct 21 15:08:36.133519 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 353/685] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:08:36 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:36.223277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:36.223889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:36.230056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:36.230873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:36.231318 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:36.235591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:36.235591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:36.235591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:36.481460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:36.490916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a2f435c1-5d70-4557-b8c1-f7b3b71f4d5d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.271434 Oct 21 15:08:36.494055 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 333/686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:36 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:37.315450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb330ad8-3230-4a73-8657-b7ad0f3d7875", "tag": "07561374-f0cb-41d8-88e2-2decd05a6e6e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:37.325329 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:37.325848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:37.326831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:37.338292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] Creating event network-changed:07561374-f0cb-41d8-88e2-2decd05a6e6e for instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 on hv-cinder-83608 Oct 21 15:08:37.347125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-5f8e1056-fedf-4ca7-a4bc-f6a2f6db7a0e req-269384cb-fd7f-48fc-a1cb-74305c34a1be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Oct 21 15:08:37.347125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 354/687] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:37.515369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:37.515984 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:37.522848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:37.523342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:37.523977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:37.525067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:37.525534 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:37.526148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:37.670138 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:37.676744 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dd0a3a1a-00e4-4542-920a-7040adbcbcff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.165413 Oct 21 15:08:37.677417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 334/688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:37 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:37.758179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1787743502"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:37.758866 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:37.765649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:37.766187 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:37.766556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:37.767269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:37.767719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:37.768133 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:37.934524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.network.security_group_api [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Adding security group 1babb31a-0977-46c2-88f8-be0c65d9ec08 to port ec944e0e-612e-4817-bd86-18a2f862bac2 Oct 21 15:08:38.377567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0e11f9ec-3cc0-49fe-b425-c24aa7c04f90 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action" status: 202 len: 0 microversion: 2.1 time: 0.624047 Oct 21 15:08:38.378201 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 355/689] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:08:37 2022] POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:08:38.386958 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:38.387567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:38.399848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:38.400340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:38.400844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:38.401766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:38.402071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:38.402502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:38.583375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:38.600207 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-67c5b220-ca6d-48a8-a161-261b2c38e008 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1760 microversion: 2.1 time: 0.216918 Oct 21 15:08:38.612096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 335/690] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:38 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1760 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:38.701499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:38.702024 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:38.708077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:38.708591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:38.709024 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:38.709839 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:38.710294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:38.710809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:38.845045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:38.853169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ac6de72e-7513-4985-ad65-4f55e09a90ee tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1734 microversion: 2.1 time: 0.155669 Oct 21 15:08:38.853734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 356/691] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:38 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:39.359045 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:39.368449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:39.368927 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:39.369354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:39.380260 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] Creating event network-changed:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:08:39.385107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-986e50e2-413d-4abb-99bd-a1294357a7c1 req-4409f236-76ad-4580-9787-256454270c56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029700 Oct 21 15:08:39.385777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 336/692] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:39.878262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:39.878907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:39.885513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:39.885991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:39.886424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:39.887162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:39.887618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:39.888045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:39.892110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:40.018785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:40.026998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0cf09705-ef43-4cbb-b71c-3e85ce8cf018 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1714 microversion: 2.1 time: 0.152565 Oct 21 15:08:40.027567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 357/693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:39 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:40.144040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:40.144647 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:40.150769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.151248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.151695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.152355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.152808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.153226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.241405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] HTTP exception thrown: Cannot 'detach_volume' instance e6689dc5-351a-4f46-b892-2788f4f5793a while it is in vm_state rescued Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Request method failure captured: Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments/5594a1b4-40b4-4a3a-87ce-25aa7adffec8 HTTP/1.1 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrTxd0cVS7SdSiGAMbiivxdPOq2kQeZlcntvOExUBUWe_x_JNWrbP-Ctu6GlGDHioabdBFsahcypxdeAjmPSD1__YhHx9hic97xFbj5UbTqkTy5eo7mpp23yw1Geqdx0SSuHoRaSNMKe_KZajpniRZBV8I6hwO_uwjjn8LL32blLPIw Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:08:40.243031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbced7abbedc497f86e2ea999420b2a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 8632f75445ef4fd3a2f1ebbc2ed87e5b Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:08:40.244400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Cannot 'detach_volume' instance e6689dc5-351a-4f46-b892-2788f4f5793a while it is in vm_state rescued Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'server_id': 'e6689dc5-351a-4f46-b892-2788f4f5793a', 'id': '5594a1b4-40b4-4a3a-87ce-25aa7adffec8'} Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6689dc5-351a-4f46-b892-2788f4f5793a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:08:40.245102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e6689dc5-351a-4f46-b892-2788f4f5793a while it is in vm_state rescued Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e6689dc5-351a-4f46-b892-2788f4f5793a while it is in vm_state rescued Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:08:40.246340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Returning 409 to user: Cannot 'detach_volume' instance e6689dc5-351a-4f46-b892-2788f4f5793a while it is in vm_state rescued {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:08:40.248846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d38dd05b-3c72-4087-8b08-dedaab3d6ed1 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments/5594a1b4-40b4-4a3a-87ce-25aa7adffec8" status: 409 len: 152 microversion: 2.1 time: 0.105369 Oct 21 15:08:40.248846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 337/694] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:08:40 2022] DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments/5594a1b4-40b4-4a3a-87ce-25aa7adffec8 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 21 15:08:40.253428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:40.258514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:40.259768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.260251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.260684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.261366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.261820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.262237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.499008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-71023c5e-d031-4491-9852-71e34a069d5c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/action" status: 202 len: 0 microversion: 2.1 time: 0.249191 Oct 21 15:08:40.500524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 358/695] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:08:40 2022] POST /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:08:40.507796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:40.508414 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:40.514542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.515042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.515787 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.516657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:40.517111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:40.517533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:40.651337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:40.660832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-928ba575-17a9-4beb-98bf-e71543a51976 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1722 microversion: 2.1 time: 0.156884 Oct 21 15:08:40.661451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 338/696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:40 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:41.686275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:41.687167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:41.693273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:41.693749 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:41.694178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:41.694893 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:41.695345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:41.695761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:41.826490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:41.834613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-dbf287c1-13a1-41f6-8049-2ee2b98a9019 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1722 microversion: 2.1 time: 0.154132 Oct 21 15:08:41.835189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 359/697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:41 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:42.858954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:42.859592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:42.866136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:42.866616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:42.867074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:42.867755 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:42.868205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:42.868625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:42.996568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:43.005494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-97b42196-451f-4952-be64-175c7ea2db21 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1722 microversion: 2.1 time: 0.150800 Oct 21 15:08:43.006052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 339/698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:42 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:44.029212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:44.029834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:44.036442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:44.036924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:44.037358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:44.038049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:44.038501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:44.038974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:44.171507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:44.179654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cb10b68f-4f75-4f83-976e-10443c9a7e76 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1722 microversion: 2.1 time: 0.154870 Oct 21 15:08:44.180211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 360/699] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:44 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:45.202878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:45.212507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:45.212507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:45.212507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:45.212507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:45.212972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:45.212972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:45.212972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:45.339454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:45.347580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2bebe55b-6b96-4ce9-a85c-d9bbab1f07e0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1728 microversion: 2.1 time: 0.148881 Oct 21 15:08:45.348143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 340/700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:45 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:45.370395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:45.370934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:45.377949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:45.378434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:45.378912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:45.379605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:45.380061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:45.380481 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:45.455700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-95da68d0-8782-49dc-b5b1-d67dd9fa6c56 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089043 Oct 21 15:08:45.456328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 361/701] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:08:45 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:46.135450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:46.135945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:46.142561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:46.143078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:46.143515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:46.144258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:46.144715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:46.145141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:46.150217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:46.227706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lazy-loading 'services' on Instance uuid 01fd0142-c1a4-480c-9c84-114dea2d4a78 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:08:46.426364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f2d01f22-9459-4432-838b-7eba4ec6b103 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments/ba018de5-752f-4400-a569-9e0a296ab2e7" status: 202 len: 0 microversion: 2.1 time: 0.294695 Oct 21 15:08:46.427429 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 341/702] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:08:46 2022] DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments/ba018de5-752f-4400-a569-9e0a296ab2e7 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:08:46.615522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:46.628713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:46.629297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:46.629974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:46.644006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] Creating event network-changed:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:08:46.649102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-21cbb573-2341-4df5-9628-928eb4416fb5 req-aa76e6f0-65c4-4ed2-8246-7ddd22857aa3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038829 Oct 21 15:08:46.650847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 362/703] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:08:48.613555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:48.620159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:48.620637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:48.621067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:48.665833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:48.676133 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:48.676612 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:48.677041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:48.680643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Going to try to stop instance {{(pid=119357) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 21 15:08:48.687706 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] Creating event network-changed:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:08:48.692396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-9279c4d4-a723-4a9b-8c6b-c9efeffd155c req-2fbd2707-3421-42ab-b142-d8dfa2c722ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031132 Oct 21 15:08:48.692986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 363/704] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:08:48.853354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7a951251-8608-4738-b314-1785225db605 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action" status: 202 len: 0 microversion: 2.1 time: 0.243433 Oct 21 15:08:48.857048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 342/705] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:08:48 2022] POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:08:48.863287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:48.864230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:48.870732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:48.871298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:48.871800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:48.872629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:48.873442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:48.874139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:49.015064 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:49.022890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5e7aae8b-e1cd-4156-8db2-5fbe48efa243 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.163750 Oct 21 15:08:49.023453 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 364/706] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:48 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:50.047558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:50.048255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:50.054864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:50.055343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:50.055773 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:50.056459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:50.056908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:50.057326 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:50.189044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:50.196795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-986a25af-9eb1-4851-97a3-9b979f480df4 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.154560 Oct 21 15:08:50.197357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 343/707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:50 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:51.220320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:51.220924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:51.227450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:51.227871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:51.228301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:51.228987 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:51.229441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:51.229863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:51.362135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:51.369808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-61f18bc2-b792-44df-8871-0b3fd834ed3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.153853 Oct 21 15:08:51.370355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 365/708] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:51 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:52.394249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:52.394823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:52.401210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:52.401690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:52.402129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:52.402865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:52.403322 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:52.404587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:52.537909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:52.545933 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3cf40309-c6f3-48ba-976b-c3f38cb32558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.156500 Oct 21 15:08:52.546492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 344/709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:52 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:08:53.570583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:53.571204 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:53.581482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:53.581482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:53.581482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:53.581482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:53.581937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:53.581937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:53.709316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:53.717941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3c6d5b2b-75f1-43a5-b83b-5aecaee4d503 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.151213 Oct 21 15:08:53.718497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 366/710] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:53 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:54.740713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:54.741245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:54.743844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:08:54.749465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:54.749941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:54.750374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:54.751085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:54.751536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:54.751958 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:54.881853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:54.889609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8f9c1291-a9fd-407a-b3e7-51d99c9d2dca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.152776 Oct 21 15:08:54.890168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 345/711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:54 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:55.916284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:55.916284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:55.919687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:55.920324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:55.920759 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:55.921456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:55.921905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:55.922328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:56.051521 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:56.059291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-beef5892-da57-4b42-8eb1-d5d3cd771ed1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.150710 Oct 21 15:08:56.060366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 367/712] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:55 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:57.082974 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:57.083589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:57.090142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:57.090655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:57.091822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:57.092535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:57.092992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:57.093419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:57.225801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:57.233895 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b97f68ee-e4ec-48e0-bd3e-bb9290e41ccd tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.154677 Oct 21 15:08:57.234390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 346/713] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:57 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:58.256751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:58.257368 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:58.263841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:58.264330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:58.264768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:58.265458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:58.265919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:58.266347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:58.393735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:58.401477 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2c2d882a-6fc2-40b1-a6c9-ea7f4d857bfa tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1678 microversion: 2.1 time: 0.148589 Oct 21 15:08:58.402045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 368/714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:58 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:59.425605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:59.426207 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:59.432538 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:59.433018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:59.433451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:59.434132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:59.434582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:59.435041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:59.563396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:59.571370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d79b618d-c369-441d-b9f5-fef7af738217 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1655 microversion: 2.1 time: 0.150628 Oct 21 15:08:59.571922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 347/715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:59 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:08:59.593668 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:08:59.600040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:59.600524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:59.600959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:59.623525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Going to try to start instance {{(pid=119358) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 21 15:08:59.827640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-15472240-4d92-496b-a4b3-0369e47e7769 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action" status: 202 len: 0 microversion: 2.1 time: 0.237170 Oct 21 15:08:59.828240 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 369/716] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:08:59 2022] POST /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:08:59.836207 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:08:59.836819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:08:59.844042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:59.844459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:59.844897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:59.845591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:08:59.846044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:08:59.846465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:08:59.986938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:08:59.994854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-df4f04d4-af75-42a7-832e-1e95cd3d6a03 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1664 microversion: 2.1 time: 0.162379 Oct 21 15:08:59.995450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 348/717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:08:59 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:00.092272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:00.093581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:00.099713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.100127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.100553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.101352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.101810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.102226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.133931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7ad12502-ac14-4301-ab90-847646d91b8e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments/d36650f6-b5b5-479d-8992-55e23d7f7e14" status: 200 len: 194 microversion: 2.20 time: 0.045929 Oct 21 15:09:00.134526 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 370/718] 10.222.0.60 () {60 vars in 1454 bytes} [Fri Oct 21 15:09:00 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments/d36650f6-b5b5-479d-8992-55e23d7f7e14 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:09:00.208442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:00.208925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:00.215085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.215660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.216160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.217076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.218393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.218906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.302794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lazy-loading 'services' on Instance uuid 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:00.563949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8bc3c6ff-892b-4205-a78b-bed0c5676db5 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments/d36650f6-b5b5-479d-8992-55e23d7f7e14" status: 202 len: 0 microversion: 2.20 time: 0.359654 Oct 21 15:09:00.564613 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 349/719] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Oct 21 15:09:00 2022] DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments/d36650f6-b5b5-479d-8992-55e23d7f7e14 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:09:00.572912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:00.575074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:00.581585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.585255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.585255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.585255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:00.585255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:00.585633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:00.613447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f0dbb5d8-df15-499b-8b08-59d6d30c1d0e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044450 Oct 21 15:09:00.618134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 371/720] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Oct 21 15:09:00 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:09:01.018911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:01.019615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:01.025801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:01.026278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:01.026749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:01.027461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:01.027914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:01.028336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:01.157501 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:01.165261 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9025a5bb-26eb-464c-8fe4-82cadfd1df91 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1664 microversion: 2.1 time: 0.151475 Oct 21 15:09:01.165815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 350/721] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:01 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:01.626412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:01.628487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:01.634860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:01.635341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:01.635775 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:01.636461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:01.636914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:01.637333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:01.666891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-53e699a4-dab0-43d5-8fd9-0a3acf33af80 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045351 Oct 21 15:09:01.667441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 372/722] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Oct 21 15:09:01 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:09:02.189244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:02.189874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:02.196818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.198276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.198276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.198536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.199041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.199445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.330848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:02.338689 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1a19bccd-c03c-4ac0-a6bb-80e9e9841a69 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1668 microversion: 2.1 time: 0.153274 Oct 21 15:09:02.339262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 351/723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:02 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:02.679671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:02.683103 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:02.689254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.689730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.690161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.690888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.691339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.691755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.709788 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:02.722223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-95b89ce0-d54c-43cc-bc3a-a4130e8749cc tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046534 Oct 21 15:09:02.722804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 373/724] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Oct 21 15:09:02 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:09:02.789206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:02.789701 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:02.796133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.797146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.797577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.798257 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:02.798734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:02.799153 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:02.823450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:09:03.175169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9f992055-0f12-4ac6-bf8c-82e739da2466 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 204 len: 0 microversion: 2.20 time: 0.389428 Oct 21 15:09:03.175759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 352/725] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Oct 21 15:09:02 2022] DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 21 15:09:03.183973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:03.184575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:03.191529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:03.192006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:03.192436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:03.193116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:03.193560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:03.193976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:03.325816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:03.334926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:03.336367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:03.337521 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-54d61cbc-02ec-414b-bbf2-8bb81bcefbb0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.157394 Oct 21 15:09:03.338074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 374/726] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:03 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:09:04.364302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:04.364912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:04.371231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:04.371707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:04.372139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:04.372821 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:04.373268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:04.373691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:04.508317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:04.512101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:04.517676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:04.519175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:04.520324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c396dd17-3673-4db3-9155-b1f4ad6dd289 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.161386 Oct 21 15:09:04.520876 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 353/727] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:04 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:05.545932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:05.546460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:05.553543 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:05.554027 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:05.554461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:05.555197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:05.555653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:05.556077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:05.685861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:05.694196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:05.695709 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:05.697031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e288b791-12bd-49b8-ba8c-50a9c67a1104 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1723 microversion: 2.20 time: 0.155544 Oct 21 15:09:05.710813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 375/728] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:05 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:06.119735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd", "name": "network-vif-deleted", "tag": "3dcce850-3070-43ac-9708-ec49271ce80e"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:06.130369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:06.132086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:06.132086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:06.142879 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] Creating event network-vif-deleted:3dcce850-3070-43ac-9708-ec49271ce80e for instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd on hv-cinder-83608 Oct 21 15:09:06.147775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-a4e79bc1-46d3-4b41-8980-05fe91e7f12c req-a0eb2929-2b53-42f6-90d9-4654760f1137 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Oct 21 15:09:06.148387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 354/729] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:06.723207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:06.723820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:06.730304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:06.730905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:06.731412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:06.732170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:06.732697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:06.733189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:06.764216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:06.764700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:06.765135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:06.765575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lazy-loading 'fault' on Instance uuid 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:06.805910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:06.814348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:06.815862 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:06.817007 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-afbf3733-1c09-4e16-8e99-641c52923479 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 200 len: 1370 microversion: 2.20 time: 0.098290 Oct 21 15:09:06.817581 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 376/730] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:06 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:07.843498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:07.844210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:07.851591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:07.852078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:07.852511 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:07.853200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:07.853661 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:07.854098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:07.868283 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd HTTP/1.1 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:09:07.869919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:09:07.871675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd'} Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:09:07.872607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:09:07.874078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:07.876321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:09:07.876321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-287874b2-21d2-4157-a048-22487b40be89 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 404 len: 111 microversion: 2.20 time: 0.032655 Oct 21 15:09:07.876321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 355/731] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:07 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:09:07.880978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8ca8166e-261d-4e19-98c9-c0eb5328d093 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '.version_select at 0x7fd1e0c85820>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:07.887961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=49 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:07.996367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8ca8166e-261d-4e19-98c9-c0eb5328d093 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987788660" status: 204 len: 0 microversion: 2.20 time: 0.119111 Oct 21 15:09:07.996958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 377/732] 10.222.0.60 () {60 vars in 1259 bytes} [Fri Oct 21 15:09:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987788660 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 21 15:09:08.737817 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b533e9c8-986a-418c-b076-bbbe6188cfeb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: .version_select at 0x7fd1e0dec3a0>, body: {"keypair": {"name": "tempest-keypair-391642427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9HlNfK10dD1DNH2EMASMVO9s9ES1tKIx/4Sr+AaEqSQ04E9AG3ZNR9HwYdBDJRB307Z7h2F5PdZ9Cql7LuWaMVivGycyGvdVMxmcCMBHb2/IBZo5Tt5uGte/vxhjQ37w=="}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:08.754158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-b533e9c8-986a-418c-b076-bbbe6188cfeb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for project c83d10829a81437fb4d56fe488581212. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:09:08.758180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-b533e9c8-986a-418c-b076-bbbe6188cfeb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for user 4593c3fd1739432fa57f4a94c65cd299 and project c83d10829a81437fb4d56fe488581212. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:09:08.827815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b533e9c8-986a-418c-b076-bbbe6188cfeb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094139 Oct 21 15:09:08.828411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 356/733] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Oct 21 15:09:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 21 15:09:10.856322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:10.858468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:10.865031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:10.865515 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:10.865943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:10.866649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:10.867097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:10.867512 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:11.066930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-429482697", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea25e75c-f122-4224-a461-b96ad815c898"}], "security_groups": [{"name": "tempest-securitygroup--845204158"}], "key_name": "tempest-keypair-391642427", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:11.076551 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-74f85a22-37f8-4cb1-a620-748e227f846e tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action" status: 202 len: 0 microversion: 2.1 time: 0.224419 Oct 21 15:09:11.077437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 378/734] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:09:10 2022] POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:09:11.086020 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:11.087715 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:11.093199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:11.093895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:11.094921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:11.095764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:11.096225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:11.096684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:11.388704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] validate_networks() for [('ea25e75c-f122-4224-a461-b96ad815c898', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:09:11.423472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:11.432326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7b9e5ac2-b7d5-426d-b8ed-265a0002581d tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1752 microversion: 2.1 time: 0.350341 Oct 21 15:09:11.434257 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 379/735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:11 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1752 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:09:11.764161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:09:11.764583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:09:11.765051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:09:11.765453 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:09:11.765915 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:09:11.775929 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:11.776422 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:11.776864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:11.777597 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:11.778056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:11.778486 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:11.795898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for project c83d10829a81437fb4d56fe488581212. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:09:11.800142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Getting quotas for user 4593c3fd1739432fa57f4a94c65cd299 and project c83d10829a81437fb4d56fe488581212. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:09:11.811227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:09:11.814290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:09:11.972274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f5862db2-ef6b-4f6f-a1d2-9fe7d578dff1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.911032 Oct 21 15:09:11.972820 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 357/736] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Oct 21 15:09:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 21 15:09:11.985085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:11.990055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:12.041737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:12.050903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:12.052343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:12.053462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-af8796ea-1b8e-4bf2-a64d-890e0f3fa700 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1280 microversion: 2.20 time: 0.072406 Oct 21 15:09:12.054012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 380/737] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:11 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:12.457546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:12.458194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:12.464293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:12.464775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:12.465220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:12.466004 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:12.466349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:12.466803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:12.613242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:12.621702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d1f4f141-97fe-4253-98a8-ed425f4adbaf tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.169259 Oct 21 15:09:12.622259 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 358/738] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:12 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:13.078973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:13.079640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:13.086747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:13.087236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:13.087674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:13.088371 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:13.088823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:13.089246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:13.149874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:13.158513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:13.160069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:13.161308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6b48418f-5987-4d25-84d7-c36d666427cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1284 microversion: 2.20 time: 0.086483 Oct 21 15:09:13.161883 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 381/739] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:13 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:13.649224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:13.649833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:13.656440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:13.658162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:13.658597 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:13.659311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:13.659765 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:13.660589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:13.806209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:13.815287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-84088a78-91e0-40f4-a0f8-67d5967ce72f tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.169854 Oct 21 15:09:13.815851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 359/740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:13 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:14.186402 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:14.187057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:14.193608 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:14.194087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:14.194524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:14.195247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:14.195707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:14.196136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:14.259057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:14.267858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:14.269290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:14.270382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ea01bb6e-22fa-42b2-a806-312a502fd31a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1332 microversion: 2.20 time: 0.087929 Oct 21 15:09:14.270972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 382/741] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:14 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:14.838498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:14.839134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:14.845838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:14.846334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:14.846790 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:14.847490 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:14.847942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:14.848368 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:14.990495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:14.998770 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-21f1569e-7cc3-46a3-8f1e-c6e8414852bd tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.164104 Oct 21 15:09:14.999329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 360/742] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:14 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:15.295822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:15.296422 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:15.303127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:15.303612 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:15.304051 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:15.304748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:15.305205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:15.305627 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:15.449934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:15.459467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:15.464713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:15.464713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e4da1aff-3bed-4348-b558-1dd867cfbfc6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.170368 Oct 21 15:09:15.464713 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 383/743] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:15 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:16.022456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:16.023235 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:16.029505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:16.030445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:16.030574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:16.031279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:16.032477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:16.032967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:16.187614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:16.196541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-846e66b3-eed6-425e-b93d-a0f339685469 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.177960 Oct 21 15:09:16.197113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 361/744] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:16 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:16.279125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:16.288799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:16.289261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:16.289717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:16.301325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] Creating event network-changed:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:09:16.306204 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-3d57b6f9-28d6-4a40-88e0-fbb5e9d49f7b req-0765b573-211a-4684-a1ef-d8bb93892b09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 Oct 21 15:09:16.307028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 384/745] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:16.487769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:16.488378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:16.494337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:16.494869 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:16.495312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:16.496004 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:16.496465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:16.496892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:16.630255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:16.638442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:16.639925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:16.641087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a24fceef-5d7b-46c2-b884-8e60f086b18c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.157440 Oct 21 15:09:16.641774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 362/746] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:16 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:17.221897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:17.222540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:17.228694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:17.229168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:17.229650 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:17.230307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:17.230800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:17.231223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:17.372578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:17.380734 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2a748a08-91a2-4f47-858d-58166da1de38 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.164188 Oct 21 15:09:17.381303 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 385/747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:17 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:17.665543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:17.666106 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:17.673054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:17.673547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:17.673993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:17.674720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:17.675183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:17.675614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:17.803745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:17.811760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:17.813853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:17.815103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2108dabe-25bb-4d4e-b62a-9d675c5a88e0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.153510 Oct 21 15:09:17.815656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 363/748] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:17 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:18.404364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:18.404887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:18.411878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:18.412353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:18.412806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:18.413486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:18.413933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:18.414350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:18.556326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:18.564721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-40fc4a4d-2773-4770-8507-ab138cf1a268 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.164220 Oct 21 15:09:18.565281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 386/749] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:18 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:18.839897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:18.840507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:18.847518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:18.848008 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:18.848450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:18.849148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:18.849602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:18.850032 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:18.978955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:18.987337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:18.988674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:18.989779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5776eafa-454d-4a63-934c-574a5fb35c05 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.153956 Oct 21 15:09:18.990334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 364/750] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:18 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:19.587299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:19.587907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:19.594947 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:19.596144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:19.596587 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:19.597635 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:19.598099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:19.598559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:19.742535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:19.751481 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d5aeb8a4-dcdf-4edf-8882-9ceede496782 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.167474 Oct 21 15:09:19.752049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 387/751] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:19 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:20.013942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:20.014553 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:20.021097 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:20.021586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:20.022037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:20.022769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:20.023229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:20.023658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:20.157236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:20.165246 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:20.166705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:20.167805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-511a6aee-1091-42fb-9d4a-810bc064e42d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.157780 Oct 21 15:09:20.168619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 365/752] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:20 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:20.774993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:20.775676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:20.782073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:20.782550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:20.783053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:20.783744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:20.784205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:20.784626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:20.921577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:20.930160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ef9cad60-5962-4ba3-a902-e4014dd07725 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.159111 Oct 21 15:09:20.930743 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 388/753] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:20 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:21.193545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:21.194154 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:21.200660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:21.201144 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:21.201585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:21.202271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:21.202750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:21.203207 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:21.335690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:21.345139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:21.346576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:21.347716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-18d169ef-f972-472c-8e15-08bdbb923d70 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.158078 Oct 21 15:09:21.348274 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 366/754] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:21 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:21.640059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "name": "network-vif-plugged", "status": "completed", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:21.651395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:21.651897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:21.652902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:21.677853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] Creating event network-vif-plugged:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:09:21.677853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-6d5d3274-e409-4e3c-9850-b2cd14da41b4 req-38ff29b2-ca1f-4cdf-9676-ee68e77901a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 Oct 21 15:09:21.677853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 389/755] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:21.954198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:21.955084 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:21.957141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:21.957801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=10 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:21.963380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:21.963904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:21.968819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:21.968819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:21.968819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:21.968819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:22.113337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:22.121922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e7e601b0-99e4-4432-b2f7-1368fd042a89 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.172220 Oct 21 15:09:22.122499 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 367/756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:21 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:22.370672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:22.431136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:22.431877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:22.439008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:22.439496 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:22.439929 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:22.440671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:22.441117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:22.441590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:22.787282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:22.795461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:22.797776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:22.802537 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-aa954921-02e8-4d7b-a9bf-11ff1fc220a2 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1405 microversion: 2.20 time: 0.429729 Oct 21 15:09:22.802537 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 390/757] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:22 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:23.145353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:23.145862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:23.152545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:23.153032 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:23.153468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:23.154157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:23.154611 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:23.155061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:23.296922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:23.305725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-72f686ba-9b94-4b24-84e5-a40bf3b3bb68 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.164428 Oct 21 15:09:23.306291 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 368/758] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:23 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:23.823842 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:23.824499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:23.831967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:23.832443 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:23.832871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:23.833555 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:23.834013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:23.834428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:23.968825 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:23.976865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:23.978280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:23.979444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-82666491-b31e-4d0f-a6d3-cd23b482ccb7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1598 microversion: 2.20 time: 0.159495 Oct 21 15:09:23.980001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 391/759] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:09:23 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:09:24.005151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:24.005646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:24.014897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:24.014897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:24.014897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:24.014897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:24.015310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:24.015310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:24.091679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c86aacc9-5549-4cd6-b3fd-f73f0856a88b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091371 Oct 21 15:09:24.095240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 369/760] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Oct 21 15:09:23 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:09:24.329622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:24.330653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:24.337010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:24.337766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:24.338431 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:24.339223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:24.339913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:24.340414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:24.345718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:24.610974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:24.619352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f23156de-095e-43f4-b9c2-f32ec8a500b3 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1757 microversion: 2.1 time: 0.294318 Oct 21 15:09:24.619936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 392/761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:24 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1757 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:25.058350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:25.058918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:25.060897 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:25.066436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:25.067087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:25.067533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:25.071054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:25.071054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:25.071054 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:25.095075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-41d89e15-322b-4336-ac0f-97ea5a015732 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/ips" status: 200 len: 149 microversion: 2.1 time: 0.149805 Oct 21 15:09:25.099774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 370/762] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:09:24 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/ips => generated 149 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:25.189653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:25.206835 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:25.207329 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:25.207755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:25.222896 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] Creating event network-changed:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:09:25.231296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-98e530a5-bbfe-4147-ad39-c8250f0f5b5e req-1804f545-f189-4b23-bc45-4d921fc3b79d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Oct 21 15:09:25.232360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 393/763] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:25.645281 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:25.646187 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:25.652406 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:25.653124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:25.653752 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:25.654849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:25.655614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:25.656198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:25.865002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:25.873290 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7eaab255-60b9-44a4-8bb7-182edfab36e6 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1760 microversion: 2.1 time: 0.233540 Oct 21 15:09:25.873853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 371/764] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:25 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1760 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:26.802551 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c280747f-8848-4e62-a87b-8d71903cf1fc"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:26.805030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:26.811847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:26.812322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:26.813346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:26.814025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:26.814483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:26.814940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:27.529132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:27.529649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:27.536858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:27.537334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:27.537762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:27.538438 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:27.538920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:27.539343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:27.567884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8d42221b-bf40-4ba7-ac55-dbd3e6796086 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769901 Oct 21 15:09:27.573801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 394/765] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:09:26 2022] POST /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:27.623137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'services' on Instance uuid e6689dc5-351a-4f46-b892-2788f4f5793a {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:27.874652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d7a4d8c5-89a6-43b8-8622-65dda224c26e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments/5594a1b4-40b4-4a3a-87ce-25aa7adffec8" status: 202 len: 0 microversion: 2.1 time: 0.349108 Oct 21 15:09:27.875160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 372/766] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:09:27 2022] DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments/5594a1b4-40b4-4a3a-87ce-25aa7adffec8 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:09:27.884142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:27.886499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:27.893663 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:27.894152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:27.894592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:27.895320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:27.895827 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:27.896259 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:27.926757 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f7cebd5a-fd17-4ca3-8f56-47668c2840df tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Oct 21 15:09:27.927315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 395/767] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:27 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:28.940417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:28.942840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:28.949194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:28.949715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:28.950159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:28.950889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:28.951350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:28.951779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:28.969761 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:28.983317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-faa914cb-5680-441f-aec5-1ffe55699553 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Oct 21 15:09:28.983882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 373/768] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:28 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:29.996350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:29.998549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:30.005341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:30.005824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:30.006259 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:30.006979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:30.007432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:30.007851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:30.037030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4a85148d-8b5b-416c-9fd2-566b55269996 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Oct 21 15:09:30.037580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 396/769] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:29 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:31.050771 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:31.052862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:31.059591 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:31.060086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:31.060552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:31.061251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:31.061708 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:31.062137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:31.091750 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3d9b2728-041e-40cf-95e0-2bcedeb2f51a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Oct 21 15:09:31.092301 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 374/770] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:31 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:32.105033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:32.107224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:32.114241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:32.114764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:32.115201 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:32.115888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:32.116339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:32.116764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:32.146105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ae85e8c0-0a27-4454-96e9-d5f6ac72881c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Oct 21 15:09:32.146676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 397/771] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:32 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:33.159167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:33.161239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:33.167386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:33.167903 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:33.168582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:33.169306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:33.169761 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:33.170189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:33.200789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-76b1d185-dad4-4616-af9b-f8ce6616b159 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Oct 21 15:09:33.201403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 375/772] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:33 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:09:34.213601 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:34.215739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:34.222605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:34.224351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:34.225161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:34.225996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:34.226466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:34.226930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:34.262618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f400567f-9bcd-476b-b4bd-f6d600f233f8 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053055 Oct 21 15:09:34.263213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 398/773] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:34 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:35.109232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c280747f-8848-4e62-a87b-8d71903cf1fc"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:35.112226 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:35.118840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.119330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.119768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.120471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.120924 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.121395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.199306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: POST /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments HTTP/1.1 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 74 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:09:35.201089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {"volumeAttachment": {"volumeId": "c280747f-8848-4e62-a87b-8d71903cf1fc"}} Oct 21 15:09:35.202667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'server_id': 'cb330ad8-3230-4a73-8657-b7ad0f3d7875', 'body': {'volumeAttachment': {'volumeId': 'c280747f-8848-4e62-a87b-8d71903cf1fc'}}} Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:35.203664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:35.205060 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 400 to user: Invalid volume: volume c280747f-8848-4e62-a87b-8d71903cf1fc is already attached to instances: cb330ad8-3230-4a73-8657-b7ad0f3d7875 {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-37f6a662-698e-4a19-ba4a-a632c1bcc323 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097460 Oct 21 15:09:35.206667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 376/774] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:09:35 2022] POST /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:09:35.270425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:35.270976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:35.276424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:35.277698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.278194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.278370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:35.278642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.279369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.279815 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.280231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.286721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.287225 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.287699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.288411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.288873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.289337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.320926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-84c363c2-aecb-4cd9-9f53-b9d9c3a6ba4d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049590 Oct 21 15:09:35.321604 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 377/775] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:35 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:09:35.413800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'services' on Instance uuid cb330ad8-3230-4a73-8657-b7ad0f3d7875 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:35.708891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-65cffc9a-2b88-4324-ade2-e081d7457d90 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments/c280747f-8848-4e62-a87b-8d71903cf1fc" status: 202 len: 0 microversion: 2.1 time: 0.442942 Oct 21 15:09:35.709484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 399/776] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:09:35 2022] DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments/c280747f-8848-4e62-a87b-8d71903cf1fc => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:09:35.717964 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:35.720137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:35.726161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.728932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.728932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.728932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:35.728932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:35.729317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:35.758967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a0e45656-c4eb-4eaa-9da9-6f4364b8d88e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Oct 21 15:09:35.759518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 378/777] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:35 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:36.333779 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:36.336130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:36.342221 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:36.342736 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:36.343175 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:36.343864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:36.344316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:36.344740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:36.375522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-70c8d170-c7ae-4bde-a853-f29393f8b36d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Oct 21 15:09:36.376083 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 400/778] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:36 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:09:36.772205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:36.774370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:36.780892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:36.781433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:36.781875 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:36.782565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:36.783051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:36.783483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:36.814552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bbfb7e64-f385-427e-a33f-83e5f6a62418 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Oct 21 15:09:36.815441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 379/779] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:36 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:37.388008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:37.390128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:37.397244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.397727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.398164 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.398889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.399348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.399772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.428043 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fba8b4ca-4ac0-4a60-9860-15da90e5f21c tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044008 Oct 21 15:09:37.428599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 401/780] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:37 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:09:37.508852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:37.509350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:37.515468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.515962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.516400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.517092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.517552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.517981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.542272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:09:37.826640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:37.828776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:37.834884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.835364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.835793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.836470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.836917 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.837331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.866305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c9c6a4af-06d3-4d8c-b8a8-252e14ed2810 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043585 Oct 21 15:09:37.866953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 402/781] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:09:37 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 21 15:09:37.903932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-af78782a-7543-471f-a967-c4bc0e757b0a tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 204 len: 0 microversion: 2.1 time: 0.398736 Oct 21 15:09:37.904548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 380/782] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:09:37 2022] DELETE /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:09:37.913376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:37.913726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:37.919826 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.920300 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.920730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.921407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.921855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.922269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.933945 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:37.934541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:37.942343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.942878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.943417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.944125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:37.944583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:37.945005 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:37.971102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:09:38.056214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:38.064048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5b11ad8c-1c39-4a46-a5f8-654ecbe1fbf0 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.155370 Oct 21 15:09:38.064622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 403/783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:37 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:38.272236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-588346ae-4fc4-48f2-bf1f-1119f3d3c8f1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 204 len: 0 microversion: 2.1 time: 0.342230 Oct 21 15:09:38.272819 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 381/784] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:09:37 2022] DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:09:38.280874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:38.281476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:38.283419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:38.288651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:38.289125 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:38.289557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:38.290229 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:38.290724 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:38.291143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:38.416585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:38.424575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c67d2544-ed22-425e-a0c9-e68d075a36db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.147445 Oct 21 15:09:38.425140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 404/785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:38 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:39.087575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:39.088270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:39.094654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:39.095146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:39.095578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:39.096288 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:39.097166 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:39.097595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:39.228127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:39.235818 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-12149bc6-636e-4001-9a14-70b943a3221b tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.152473 Oct 21 15:09:39.236312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 382/786] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:39 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:39.447942 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:39.448545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:39.455060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:39.455606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:39.456607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:39.457294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:39.457745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:39.458199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:39.587296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:39.594890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-49fae1c3-2e0d-41c2-9cd0-9d7d5b3fc61c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.150928 Oct 21 15:09:39.595457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 405/787] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:39 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:40.259874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:40.260461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:40.266901 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:40.267377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:40.267809 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:40.269676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:40.270134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:40.270558 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:40.400338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:40.407973 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eebc6dae-792c-4274-845b-79fef6875bb4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.152171 Oct 21 15:09:40.408537 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 383/788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:40 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:40.619032 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:40.619579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:40.625858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:40.626341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:40.626808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:40.627523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:40.628580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:40.628981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:40.755662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:40.763297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3d521dc3-d6e1-44bd-aac5-25ec393103b3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.148187 Oct 21 15:09:40.763858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 406/789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:40 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:41.431999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:41.432648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:41.439177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:41.439657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:41.440090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:41.441531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:41.441981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:41.442408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:41.568904 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:41.577568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-149c8005-ee2f-4863-b962-cf523ba8cecc tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.149043 Oct 21 15:09:41.578134 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 384/790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:41 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:09:41.786774 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:41.787413 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:41.794019 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:41.794501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:41.794959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:41.795646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:41.796129 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:41.796554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:41.816238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:41.928408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:41.936157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f4bd8e12-45c7-48bc-8dc0-a613821d3b0c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.153971 Oct 21 15:09:41.936698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 407/791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:41 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:42.602009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:42.602663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:42.608979 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:42.609459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:42.609895 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:42.610579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:42.611063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:42.611494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:42.739263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:42.746972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-92397705-5de6-49f6-8026-0ce9048fc856 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.148798 Oct 21 15:09:42.747536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 385/792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:42 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:42.959815 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:42.960424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:42.966887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:42.967375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:42.967813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:42.968507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:42.968968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:42.969397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:43.101128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:43.108782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-de350b19-b449-4a17-960f-a7771a769cf1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.153432 Oct 21 15:09:43.109472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 408/793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:42 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:43.770567 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:43.771196 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:43.777638 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:43.778123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:43.778552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:43.779262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:43.779715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:43.780136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:43.912679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:43.916247 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:43.921090 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ef9b3ed1-d2a2-45f4-ad72-764734d4acf5 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1688 microversion: 2.1 time: 0.154938 Oct 21 15:09:43.921652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 386/794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:43 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:44.131528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:44.132134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:44.138451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:44.138964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:44.139414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:44.140098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:44.140591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:44.141006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:44.280108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:44.291322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6ed24f4d-7f81-4b75-a4bd-6af7e54f4e3d tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1680 microversion: 2.1 time: 0.163770 Oct 21 15:09:44.308290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 409/795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:44 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:44.901967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6689dc5-351a-4f46-b892-2788f4f5793a", "name": "network-vif-deleted", "tag": "d1390b81-d0b7-4766-8202-4b68f151d17c"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:44.925578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:44.926085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:44.926517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:44.947837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:44.948877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:44.957004 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] Creating event network-vif-deleted:d1390b81-d0b7-4766-8202-4b68f151d17c for instance e6689dc5-351a-4f46-b892-2788f4f5793a on hv-cinder-83608 Oct 21 15:09:44.962412 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-8582acfc-484c-49e7-8008-1f2c32399142 req-09bf7dc9-1925-4fef-a973-e14ecf8bb5a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120719 Oct 21 15:09:44.966555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 387/796] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:09:44.966833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:44.967421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:44.967967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:44.968800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:44.969346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:44.969860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:45.047978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:45.056651 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0ff78086-ae51-4ad3-957b-103d8debc46d tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1621 microversion: 2.1 time: 0.113813 Oct 21 15:09:45.057550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 410/797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:44 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:45.317082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:45.318163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:45.324696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:45.325496 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:45.326100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:45.327020 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:45.327639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:45.328229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:45.363743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:45.364500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:45.365101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:45.366175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid cb330ad8-3230-4a73-8657-b7ad0f3d7875 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:45.407871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:45.416363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e2dd53f7-8b82-48b1-a476-732085ec11b0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1331 microversion: 2.1 time: 0.104709 Oct 21 15:09:45.417489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 388/798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:45 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:46.082209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:46.083563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:46.090996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.091514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.091953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.092718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.093118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.094165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.130983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.131484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.131924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.132500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'fault' on Instance uuid e6689dc5-351a-4f46-b892-2788f4f5793a {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:46.176247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:46.185696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-857d5c9d-eb77-4a8f-9630-103d018590ae tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 200 len: 1335 microversion: 2.1 time: 0.109127 Oct 21 15:09:46.186615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 411/799] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:46 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:46.441942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:46.442559 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:46.449025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.449510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.449953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.450649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.451136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.451565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.481941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.482423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.482887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.483331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid cb330ad8-3230-4a73-8657-b7ad0f3d7875 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:46.526959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:46.537515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3f391716-066b-4415-9bca-ce53b324dab1 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 200 len: 1331 microversion: 2.1 time: 0.099978 Oct 21 15:09:46.538098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 389/800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:46 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:46.977727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb330ad8-3230-4a73-8657-b7ad0f3d7875", "name": "network-vif-deleted", "tag": "07561374-f0cb-41d8-88e2-2decd05a6e6e"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:46.988086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:46.988773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:46.989226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:46.999989 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] Creating event network-vif-deleted:07561374-f0cb-41d8-88e2-2decd05a6e6e for instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 on hv-cinder-83608 Oct 21 15:09:47.005070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-415995fd-bc52-4931-9ba4-24b27c138be6 req-427d19a8-c6e9-4cb9-af7f-61eecc6ce4cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031001 Oct 21 15:09:47.005662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 412/801] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:47.210139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:47.210774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: e6689dc5-351a-4f46-b892-2788f4f5793a] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:47.216696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:47.217172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:47.217606 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:47.218285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:47.218763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:47.219184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:47.233083 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] HTTP exception thrown: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Request method failure captured: Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a HTTP/1.1 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrTxd0cVS7SdSiGAMbiivxdPOq2kQeZlcntvOExUBUWe_x_JNWrbP-Ctu6GlGDHioabdBFsahcypxdeAjmPSD1__YhHx9hic97xFbj5UbTqkTy5eo7mpp23yw1Geqdx0SSuHoRaSNMKe_KZajpniRZBV8I6hwO_uwjjn8LL32blLPIw Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:09:47.234723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbced7abbedc497f86e2ea999420b2a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 8632f75445ef4fd3a2f1ebbc2ed87e5b Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. Oct 21 15:09:47.236308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'e6689dc5-351a-4f46-b892-2788f4f5793a'} Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:09:47.237870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. Oct 21 15:09:47.240040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.241341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Returning 404 to user: Instance e6689dc5-351a-4f46-b892-2788f4f5793a could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:09:47.241341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-db054522-6f3c-46e2-b5a3-172c26580ed4 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a" status: 404 len: 111 microversion: 2.1 time: 0.030728 Oct 21 15:09:47.241341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 390/802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:47 2022] GET /compute/v2.1/servers/e6689dc5-351a-4f46-b892-2788f4f5793a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:09:47.245865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f521e405-54f9-4e11-9914-c2dc9a9cb25e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '.version_select at 0x7fd1e0c85700>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:47.367711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f521e405-54f9-4e11-9914-c2dc9a9cb25e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200325738" status: 202 len: 0 microversion: 2.1 time: 0.126375 Oct 21 15:09:47.368281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 413/803] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Oct 21 15:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200325738 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:09:47.561666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:47.562273 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:47.568921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:47.569402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:47.569864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:47.570555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:47.571037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:47.571463 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:47.585095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 HTTP/1.1 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:09:47.586599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:09:47.588217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'cb330ad8-3230-4a73-8657-b7ad0f3d7875'} Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:09:47.589100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:09:47.590740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:09:47.592507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:09:47.592507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-550c34fe-2b10-48f8-a479-79e4d587fa97 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 404 len: 111 microversion: 2.1 time: 0.030311 Oct 21 15:09:47.592507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 391/804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:47 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:09:47.597935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-15685050-352f-436f-b3e2-1a97e5e7b463 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '.version_select at 0x7fd1e0bc9c10>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:47.694092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-15685050-352f-436f-b3e2-1a97e5e7b463 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206734038" status: 202 len: 0 microversion: 2.1 time: 0.100774 Oct 21 15:09:47.695407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 414/805] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Oct 21 15:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206734038 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:09:48.503509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-87ce1d12-9f90-453f-8171-39c9ab9d1c8c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: .version_select at 0x7fd1e0db8af0>, body: {"keypair": {"name": "tempest-keypair-715201941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO4iQLXtj+lFv7r8H1Vn4SJ7fUTrCvD7WA0iZqqzd/cz5aUiKhClPAkV0YBIhPjwFryWiukt2Odj6zM3msSiwVhtuzNqIU7YjBty1cURoKeHDl8b9U692k0arzsrf4VUA=="}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:48.518480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-87ce1d12-9f90-453f-8171-39c9ab9d1c8c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:09:48.522464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-87ce1d12-9f90-453f-8171-39c9ab9d1c8c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'key_pairs'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:09:48.633664 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-87ce1d12-9f90-453f-8171-39c9ab9d1c8c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134197 Oct 21 15:09:48.634266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 392/806] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:09:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:50.799405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:50.800023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:50.806138 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:50.806649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:50.807097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:50.807795 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:50.808256 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:50.808678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:50.834844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:09:51.049653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1199155019", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0eade66-a654-457b-8b3f-068b28484861"}], "security_groups": [{"name": "tempest-securitygroup--1575981296"}], "key_name": "tempest-keypair-715201941", "user_data": "}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:51.130269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4c49da13-a46e-4f13-a467-679838a9e265 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 204 len: 0 microversion: 2.1 time: 0.334493 Oct 21 15:09:51.131478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 415/807] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:09:50 2022] DELETE /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:09:51.139926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:51.140660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:51.146886 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:51.147383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:51.147824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:51.148550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:51.148986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:51.149411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:51.156838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] validate_networks() for [('b0eade66-a654-457b-8b3f-068b28484861', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:09:51.350841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:51.358890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c2c6d4e1-a4a4-4da6-9498-07cbb2db31e9 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1507 microversion: 2.1 time: 0.223089 Oct 21 15:09:51.359459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 416/808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:51 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:09:51.637703 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:09:51.638130 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:09:51.638606 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:09:51.639039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:09:51.639449 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:09:51.648035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:51.648514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:51.648950 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:51.649677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:51.650135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:51.650559 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:51.667934 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:09:51.672169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Getting quotas for user 1eb3641974744d83816b6f3ad7bb6f82 and project 77156a46a45648cd8cb0ea22ab0f04a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:09:51.683555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:09:51.685810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:09:51.844690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cd39b0b6-b046-4935-a633-f31d49c7e7ac tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.799362 Oct 21 15:09:51.845277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 393/809] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:09:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:09:51.857037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cb39591b-1396-4436-9a1e-05ccbfe9b63b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:51.857645 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cb39591b-1396-4436-9a1e-05ccbfe9b63b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:51.911162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cb39591b-1396-4436-9a1e-05ccbfe9b63b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:51.918333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cb39591b-1396-4436-9a1e-05ccbfe9b63b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1241 microversion: 2.1 time: 0.065015 Oct 21 15:09:51.919195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 417/810] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:51 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:52.391252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:52.391252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:52.391252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:52.391252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:52.392075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:52.392768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:52.393214 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:52.393644 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:52.528626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:52.536700 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bd1e4409-3b97-46be-951b-10595ade1c90 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1507 microversion: 2.1 time: 0.157908 Oct 21 15:09:52.537254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 394/811] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:52 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:52.941141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:52.942284 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:52.949800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:52.950316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:52.950768 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:52.951496 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:52.951973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:52.952427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:53.015316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:53.023454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-376e8990-0393-42e8-abc2-7c49500e880c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1245 microversion: 2.1 time: 0.086150 Oct 21 15:09:53.024017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 418/812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:52 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:53.560206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:53.560826 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:53.568005 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:53.568497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:53.568940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:53.569711 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:53.570175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:53.570607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:53.919314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:53.927671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5e9d18b2-9a0a-421c-afb6-bac05009923e tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1507 microversion: 2.1 time: 0.371289 Oct 21 15:09:53.928243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 395/813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:53 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:54.047280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:54.048459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:54.056492 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.056973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.057406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.058158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.058608 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.059224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.152992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4298bf2-1299-4552-9929-5128607d4daf", "name": "network-vif-deleted", "tag": "2ec9c9f0-770b-45e7-9198-e7df0236240f"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:54.162735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:54.168518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.169255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.169856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.171336 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2a9d0f52-6a13-4d64-aa9e-aa7bd177ff80 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1293 microversion: 2.1 time: 0.128389 Oct 21 15:09:54.171912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 419/814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:54 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:54.186608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] Creating event network-vif-deleted:2ec9c9f0-770b-45e7-9198-e7df0236240f for instance c4298bf2-1299-4552-9929-5128607d4daf on hv-cinder-83608 Oct 21 15:09:54.192682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-cf83f318-ba00-4517-b546-248ee6296cdd req-3ad9889b-054f-4771-81ff-f38933322ac2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043045 Oct 21 15:09:54.199077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 396/815] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:09:54.951267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:54.952248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:54.958721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.959346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.959888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.960703 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.961302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.961810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.993712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:54.994122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:54.994558 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:54.995037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'fault' on Instance uuid c4298bf2-1299-4552-9929-5128607d4daf {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:09:55.035181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:55.042840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6e573404-4a89-431e-931b-95ee90a07642 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 200 len: 1311 microversion: 2.1 time: 0.095470 Oct 21 15:09:55.043407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 420/816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:54 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:55.196492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:55.197946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:55.204040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:55.204526 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:55.205227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:55.205935 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:55.206395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:55.206854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:55.276651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:55.288611 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2fc9367b-c516-40f6-bb7a-8c3c57eed6e0 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1311 microversion: 2.1 time: 0.096851 Oct 21 15:09:55.289673 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 397/817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:55 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:56.067778 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:56.069609 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: c4298bf2-1299-4552-9929-5128607d4daf] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:56.075069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.075550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.075977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.076668 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.077120 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.077542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.092594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] HTTP exception thrown: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Request method failure captured: Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf HTTP/1.1 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrTxd0cVS7SdSiGAMbiivxdPOq2kQeZlcntvOExUBUWe_x_JNWrbP-Ctu6GlGDHioabdBFsahcypxdeAjmPSD1__YhHx9hic97xFbj5UbTqkTy5eo7mpp23yw1Geqdx0SSuHoRaSNMKe_KZajpniRZBV8I6hwO_uwjjn8LL32blLPIw Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:09:56.094405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbced7abbedc497f86e2ea999420b2a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 8632f75445ef4fd3a2f1ebbc2ed87e5b Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. Oct 21 15:09:56.096056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'c4298bf2-1299-4552-9929-5128607d4daf'} Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:09:56.097198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. Oct 21 15:09:56.104085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:09:56.105409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Returning 404 to user: Instance c4298bf2-1299-4552-9929-5128607d4daf could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:09:56.105409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-06a7a6d6-f2cd-4b49-b9a6-e649ec98a923 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf" status: 404 len: 111 microversion: 2.1 time: 0.032903 Oct 21 15:09:56.105409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 421/818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:56 2022] GET /compute/v2.1/servers/c4298bf2-1299-4552-9929-5128607d4daf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:09:56.105654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:56.105654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:56.107725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:56.112407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.112918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.113299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.114713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.115172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.115598 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.142607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:09:56.319099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:56.319722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:56.325590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.326079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.326538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.327372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.327833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.328265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.469644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:56.477637 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-19175de6-8434-4205-afe7-ded4168d2b3f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.163118 Oct 21 15:09:56.478220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 422/819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:56 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:09:56.492385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e158f223-5e37-4c31-a8ae-cc613f448aa2 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 204 len: 0 microversion: 2.1 time: 0.390808 Oct 21 15:09:56.493066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 398/820] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:09:56 2022] DELETE /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:09:56.501059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:56.505557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:56.508234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.508718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.509157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.509846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:56.510305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:56.510782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:56.795783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:56.804217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-af3fa62d-5ff5-44b1-a94d-4bd33e2978ff tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.306917 Oct 21 15:09:56.804782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 423/821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:56 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:57.072872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d214d1-0e41-47a1-8911-9b6b9bab49fc", "tag": "d835a37e-e47e-43a7-9a54-1d55d85ad6d4"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:57.082815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:57.083302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:57.083733 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:57.094955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] Creating event network-changed:d835a37e-e47e-43a7-9a54-1d55d85ad6d4 for instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc on hv-cinder-83608 Oct 21 15:09:57.101252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-7536a892-c002-404e-b6f0-3e9eae2b3768 req-cc169924-cdb3-4b86-8d8e-b5db090ff668 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Oct 21 15:09:57.101913 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 399/822] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:09:57.501132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:57.501741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:57.508840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:57.509323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:57.509755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:57.510442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:57.510921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:57.511345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:57.637572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:57.646538 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1a7fccdf-cdc6-4880-aeb9-baab8c9d7514 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.148524 Oct 21 15:09:57.647151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 424/823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:57 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:57.828374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:57.829068 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:57.836158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:57.836639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:57.837070 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:57.837777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:57.838303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:57.838766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:57.967349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:57.975241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e9427cbb-f96b-49da-8f3b-25d5327fc983 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.151020 Oct 21 15:09:57.975811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 400/824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:57 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:58.669928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:58.670530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:58.677065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:58.677546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:58.678029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:58.678871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:58.679382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:58.679803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:58.808652 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:58.816372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9ae12aed-51b5-4de8-86cd-7812f24e8629 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.150566 Oct 21 15:09:58.816915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 425/825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:58 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:58.998492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:58.999133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:59.005630 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:59.006796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:59.007281 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:59.008013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:59.008435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:59.008863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:59.139475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:09:59.147963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bd91c6fb-cbc0-4f62-8242-50ef93083993 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1521 microversion: 2.1 time: 0.153252 Oct 21 15:09:59.148620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 401/826] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:58 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:09:59.839709 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:09:59.840514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:09:59.847056 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:59.847550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:59.847968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:59.848654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:59.849102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:59.851657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:59.854271 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:09:59.971107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3f579-4139-41ae-a20b-b25f1c6b95a7", "name": "network-vif-deleted", "tag": "f027ca64-6e10-42a3-a356-857ce1a446a0"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:09:59.981277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:09:59.982115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:09:59.982618 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:09:59.994975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] Creating event network-vif-deleted:f027ca64-6e10-42a3-a356-857ce1a446a0 for instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 on hv-cinder-83608 Oct 21 15:09:59.998014 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:00.000210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-2c3c0d9a-30db-4ecc-bb88-63956c8b2921 req-72431dcb-9a1c-4cca-b221-464235856657 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Oct 21 15:10:00.000919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 402/827] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:10:00.010010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9929ac51-5293-4de1-9bb7-a01fc554844b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.175091 Oct 21 15:10:00.010919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 426/828] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:09:59 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:00.172542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:00.173269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:00.179822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:00.180309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:00.180815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:00.181548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:00.182280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:00.182698 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:00.246116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:00.254354 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b817174f-9af6-4242-a0e3-ebf1ceefc8e7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1479 microversion: 2.1 time: 0.086685 Oct 21 15:10:00.254995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 403/829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:00 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:01.037919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:01.038540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:01.045575 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:01.046061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:01.046498 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:01.047231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:01.047690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:01.048117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:01.179265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:01.186680 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d5742193-5d37-4119-8534-998df140dd25 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.153221 Oct 21 15:10:01.187226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 427/830] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:01 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:01.278343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:01.278983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:01.285033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:01.286145 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:01.286581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:01.287299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:01.288440 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:01.288812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:01.321495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:01.321975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:01.322407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:01.322899 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lazy-loading 'fault' on Instance uuid 96d3f579-4139-41ae-a20b-b25f1c6b95a7 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:01.366941 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8632f75445ef4fd3a2f1ebbc2ed87e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbced7abbedc497f86e2ea999420b2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:01.375329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-491100e0-bbe5-4a05-b136-3ad3f14bedb7 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 200 len: 1311 microversion: 2.1 time: 0.100832 Oct 21 15:10:01.376052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 404/831] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:01 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:02.209858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:02.210467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:02.212947 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:02.218248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:02.218759 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:02.219350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:02.220039 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:02.220498 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:02.220922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:02.346742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:02.355073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cda244ae-96ce-43ec-9c8f-9301ce5b9506 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.149567 Oct 21 15:10:02.355675 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 428/832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:02 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:02.399369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:02.399981 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] [instance: 96d3f579-4139-41ae-a20b-b25f1c6b95a7] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:02.401948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:02.402759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=10 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:02.407938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:02.409384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:02.409384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:02.409592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:02.410002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:02.410435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:02.425075 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] HTTP exception thrown: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Request method failure captured: Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 HTTP/1.1 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrTxd0cVS7SdSiGAMbiivxdPOq2kQeZlcntvOExUBUWe_x_JNWrbP-Ctu6GlGDHioabdBFsahcypxdeAjmPSD1__YhHx9hic97xFbj5UbTqkTy5eo7mpp23yw1Geqdx0SSuHoRaSNMKe_KZajpniRZBV8I6hwO_uwjjn8LL32blLPIw Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:02.426760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbced7abbedc497f86e2ea999420b2a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbced7abbedc497f86e2ea999420b2a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: bbced7abbedc497f86e2ea999420b2a0 Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-168757875 Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 8632f75445ef4fd3a2f1ebbc2ed87e5b Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-168757875-project Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. Oct 21 15:10:02.428837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '96d3f579-4139-41ae-a20b-b25f1c6b95a7'} Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:02.429749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. Oct 21 15:10:02.431194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:02.432570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] Returning 404 to user: Instance 96d3f579-4139-41ae-a20b-b25f1c6b95a7 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:02.432570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1acb7546-44f7-48d2-9b75-ccfa5a948d34 tempest-ServerRescueNegativeTestJSON-168757875 tempest-ServerRescueNegativeTestJSON-168757875-project] 10.222.0.60 "GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7" status: 404 len: 111 microversion: 2.1 time: 0.033132 Oct 21 15:10:02.432570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 405/833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:02 2022] GET /compute/v2.1/servers/96d3f579-4139-41ae-a20b-b25f1c6b95a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:03.378174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:03.378813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:03.385813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:03.386299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:03.386752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:03.387444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:03.387894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:03.388310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:03.521991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:03.528859 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e0b44f50-ffd5-4b3e-9a4f-43bb45c024ee tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.154489 Oct 21 15:10:03.529533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 429/834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:03 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:04.559302 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:04.560673 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:04.569298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:04.570072 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:04.570713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:04.571596 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:04.572205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:04.572796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:04.792996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:04.801272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-30b0f592-db32-43e6-819d-3464b18957ba tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.251462 Oct 21 15:10:04.815266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 406/835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:04 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:04.826421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1787743502"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:04.827074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:04.833379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:04.833864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:04.834364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:04.835160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:04.835690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:04.836121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:04.987596 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.network.security_group_api [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Removing security group 1babb31a-0977-46c2-88f8-be0c65d9ec08 from port ec944e0e-612e-4817-bd86-18a2f862bac2 Oct 21 15:10:05.607077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-05861d90-7cf7-4a23-aae8-9f8778ec840c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action" status: 202 len: 0 microversion: 2.1 time: 0.783499 Oct 21 15:10:05.607961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 430/836] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:10:04 2022] POST /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:10:05.701930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:05.715241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.715806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.716311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.726320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:05.727918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:05.730447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:05.738035 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.738909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.739540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.742039 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.743162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.743983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.745646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] Creating event network-changed:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:10:05.752108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-e2158f2a-785c-4a9e-98de-56b704d77c37 req-55799521-59ce-4ba6-97f6-003e00ecd8c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136125 Oct 21 15:10:05.766546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 407/837] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:05.788935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-72a497cb-0d8c-414c-9690-ada2ab4bb2b8 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067406 Oct 21 15:10:05.790439 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 431/838] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:10:05 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 21 15:10:05.831479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:05.835848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:05.854198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.858865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.858865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.860194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.862276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.863707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.925304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:05.941852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:05.945004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.945304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.945929 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.946836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:05.947441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:05.948015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:05.999116 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:10:06.080059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:06.089443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2045b99d-8d52-4a0e-aebf-39d2c7d3f45f tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.267511 Oct 21 15:10:06.090643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 408/839] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:05 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:06.335424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d214d1-0e41-47a1-8911-9b6b9bab49fc", "name": "network-vif-plugged", "status": "completed", "tag": "d835a37e-e47e-43a7-9a54-1d55d85ad6d4"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:06.345963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:06.346774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:06.347309 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:06.363041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] Creating event network-vif-plugged:d835a37e-e47e-43a7-9a54-1d55d85ad6d4 for instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc on hv-cinder-83608 Oct 21 15:10:06.368865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-2190ba71-6dbe-43ef-9237-1562488bfe5d req-15783076-4218-4775-a9be-27e80acfea94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115195 Oct 21 15:10:06.369715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 409/840] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:10:06.411225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b5305417-125f-463f-b713-056169e427ef tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 204 len: 0 microversion: 2.1 time: 0.489332 Oct 21 15:10:06.413370 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 432/841] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:10:05 2022] DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:10:06.422931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:06.424593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:06.452454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:06.455355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:06.458306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:06.458306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:06.458306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:06.458306 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:06.692394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:06.706159 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-45a0b9e4-2bb5-4ab3-b400-ce5c80507974 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1674 microversion: 2.1 time: 0.287975 Oct 21 15:10:06.719689 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 410/842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:06 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1674 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:07.113728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:07.118532 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:07.121068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.121631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.122074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.122808 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.123273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.123719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.318404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:07.326804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-35afb1b2-0043-4fd3-99a1-ee94972446c2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.217333 Oct 21 15:10:07.327371 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 433/843] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:07 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:07.561784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:07.569938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:07.569938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.570227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.570428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.571393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.571853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.572285 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.660719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lazy-loading 'services' on Instance uuid bc662f58-53e9-4c89-929e-0254f9bc3e38 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:07.733821 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:07.734445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:07.742096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.742603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.743069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.743793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.744254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.744684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.901062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:07.910363 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-71378d96-7295-4224-8aa9-3635d9ebc828 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1674 microversion: 2.1 time: 0.180520 Oct 21 15:10:07.911847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 434/844] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:07 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:07.919552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:07.930956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.931754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.932850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-56047984-1b60-43a9-91c0-2002bc33e2da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments/d63e227f-8981-429f-b5fc-3e4dd47b56e7" status: 202 len: 0 microversion: 2.1 time: 0.373467 Oct 21 15:10:07.932850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 411/845] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:10:07 2022] DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments/d63e227f-8981-429f-b5fc-3e4dd47b56e7 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:10:07.933974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.945374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:07.948047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:07.955229 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] Creating event network-changed:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:10:07.956204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.956862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.957631 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.959210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:07.959934 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:07.961678 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:07.963452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-ddb7026b-36d2-4cb4-80b6-d942f5fdb6aa req-da4b3e13-01c7-4455-a6f5-c407bcf1574d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048091 Oct 21 15:10:07.964636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 435/846] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:07.999997 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2a98de70-da80-4fc2-9edf-6b03b5fb5022 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061878 Oct 21 15:10:08.005239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 412/847] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:10:07 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:08.352536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:08.353771 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:08.360444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:08.361163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:08.361819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:08.363087 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:08.363695 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:08.364257 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:08.514212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:08.521946 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f4f865a5-073b-4105-b503-3277e2507f9b tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.175403 Oct 21 15:10:08.522610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 436/848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:08 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:08.935688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:08.936348 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:08.942583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:08.943088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:08.943593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:08.944826 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:08.945289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:08.945716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.014507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.017680 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:09.025090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:09.033324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.036930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.041296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.042065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.042531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.042986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.090568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ae335c7d-c653-4d0b-89c6-336f79edb934 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080611 Oct 21 15:10:09.091529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 437/849] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:10:09 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:09.146411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:09.155873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3fad0ad6-1fd8-46ef-aec0-c8d4d889682d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1674 microversion: 2.1 time: 0.224044 Oct 21 15:10:09.156455 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 413/850] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:08 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:09.235855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8c98fe8a-49bc-4cf5-9fbe-55b89ea05f8f tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Action: 'create', calling method: .version_select at 0x7fd1e0c26700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-930896165", "metadata": {"Type": "work"}}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8c98fe8a-49bc-4cf5-9fbe-55b89ea05f8f tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 121 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:10:09.260510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-930896165", "metadata": {"Type": "work"}}} Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:10:09.262124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-930896165', 'metadata': {'Type': 'work'}}}} Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise error Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi '#$%' Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.263130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 21 15:10:09.265021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 21 15:10:09.266454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 21 15:10:09.266454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.272469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8c98fe8a-49bc-4cf5-9fbe-55b89ea05f8f tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.272469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8c98fe8a-49bc-4cf5-9fbe-55b89ea05f8f tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165676 Oct 21 15:10:09.272469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 438/851] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Oct 21 15:10:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 21 15:10:09.281143 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-95961db5-e791-4fc5-9f82-086d59df2552 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Action: 'create', calling method: .version_select at 0x7fd1e0decdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1079563585", "metadata": {"Type": "work"}}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-95961db5-e791-4fc5-9f82-086d59df2552 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 120 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:09.286223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1079563585", "metadata": {"Type": "work"}}} Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: Oct 21 15:10:09.287938 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1079563585', 'metadata': {'Type': 'work'}}}} Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise error Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi '0' Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.288998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 21 15:10:09.290617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 21 15:10:09.292012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 21 15:10:09.292012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.292012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-95961db5-e791-4fc5-9f82-086d59df2552 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.292889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-95961db5-e791-4fc5-9f82-086d59df2552 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015458 Oct 21 15:10:09.293650 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 414/852] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Oct 21 15:10:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:10:09.308980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a8dee3de-a621-4b34-9b7e-8437dff035b4 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Action: 'create', calling method: .version_select at 0x7fd1e0bcadc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-456671071", "metadata": {"Type": "work"}}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a8dee3de-a621-4b34-9b7e-8437dff035b4 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 118 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:10:09.312767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-456671071", "metadata": {"Type": "work"}}} Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:10:09.314294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-456671071', 'metadata': {'Type': 'work'}}}} Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise error Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi '' Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.315301 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 21 15:10:09.316816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 21 15:10:09.319063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 21 15:10:09.319063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.319063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a8dee3de-a621-4b34-9b7e-8437dff035b4 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.319063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a8dee3de-a621-4b34-9b7e-8437dff035b4 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009170 Oct 21 15:10:09.324652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8aed236b-244d-429a-aa6b-52e237c12612 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Calling method '.version_select at 0x7fd1e0dfdf70>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.330728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 439/853] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Oct 21 15:10:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 21 15:10:09.356232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-8aed236b-244d-429a-aa6b-52e237c12612 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] HTTP exception thrown: Volume tempest-invalid-1041062493 could not be found. Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8aed236b-244d-429a-aa6b-52e237c12612 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1041062493 HTTP/1.1 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:09.371988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Volume tempest-invalid-1041062493 could not be found. Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'tempest-invalid-1041062493'} Oct 21 15:10:09.373679 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1041062493 could not be found. (HTTP 404) (Request-ID: req-7ece9227-65fa-45f7-b17b-bde874d1577d) Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.374626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:10:09.376009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1041062493 could not be found. Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:09.377295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1041062493 could not be found. Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1041062493 could not be found. Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8aed236b-244d-429a-aa6b-52e237c12612 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 404 to user: Volume tempest-invalid-1041062493 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.378448 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8aed236b-244d-429a-aa6b-52e237c12612 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1041062493" status: 404 len: 99 microversion: 2.1 time: 0.052907 Oct 21 15:10:09.387898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8360a504-0c06-4af3-beef-138a80fdbfa3 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005187 Oct 21 15:10:09.392295 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 440/854] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Oct 21 15:10:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 21 15:10:09.401339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 415/855] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Oct 21 15:10:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1041062493 => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 21 15:10:09.402303 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1cf52e4a-ff82-4a57-83d9-b48a85c59683 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004508 Oct 21 15:10:09.402303 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 441/856] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Oct 21 15:10:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 21 15:10:09.409488 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3544130-e1d8-465f-b5a8-ecd00edcef87 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Calling method '.version_select at 0x7fd1e466a670>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.440394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-a3544130-e1d8-465f-b5a8-ecd00edcef87 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] HTTP exception thrown: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3544130-e1d8-465f-b5a8-ecd00edcef87 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/os-volumes/8c697b0d-7061-4205-84db-69d32fde4319 HTTP/1.1 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:09.442764 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '8c697b0d-7061-4205-84db-69d32fde4319'} Oct 21 15:10:09.444893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. (HTTP 404) (Request-ID: req-38dc6e96-d087-4321-9a5a-bed6d682901e) Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.445928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 21 15:10:09.448651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 21 15:10:09.451387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3544130-e1d8-465f-b5a8-ecd00edcef87 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 404 to user: Volume 8c697b0d-7061-4205-84db-69d32fde4319 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a3544130-e1d8-465f-b5a8-ecd00edcef87 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8c697b0d-7061-4205-84db-69d32fde4319" status: 404 len: 109 microversion: 2.1 time: 0.039960 Oct 21 15:10:09.454528 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 416/857] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:10:09 2022] DELETE /compute/v2.1/os-volumes/8c697b0d-7061-4205-84db-69d32fde4319 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:09.459851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1142263d-fa28-48cb-be72-aa9b8b289928 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Calling method '.version_select at 0x7fd1e0bc99d0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.489238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-1142263d-fa28-48cb-be72-aa9b8b289928 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] HTTP exception thrown: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1142263d-fa28-48cb-be72-aa9b8b289928 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Request method failure captured: Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/os-volumes/4e69401c-a996-467e-a995-f7ef4e715673 HTTP/1.1 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrZRoBply2sq7WAR5B2nYVITkWCGoJUoQiJ6VLnfpPDPSMnlq2xomFaZs9qDxjYWDuiQjC4ikCBGgqwgW_E-Wz5FhSJaLDKg40ZX8C8vOEPz5DAaAK1pY037FbLUb15BHDAdEY-8MslSzPFbUZcE8DPGiBwmgllX4MzpKuohbkFgwaE Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:10:09.491262 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e0b585adcbe46adb374b8989ba3c4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e0b585adcbe46adb374b8989ba3c4f1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 6e0b585adcbe46adb374b8989ba3c4f1 Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesNegativeTest-479244465 Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 0b7e7a5db4054a30994e9cd5ea36109c Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesNegativeTest-479244465-project Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '4e69401c-a996-467e-a995-f7ef4e715673'} Oct 21 15:10:09.492829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. (HTTP 404) (Request-ID: req-3309618e-2432-46cf-bd40-577d1dd9a518) Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.493790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 21 15:10:09.495232 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 21 15:10:09.496804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1142263d-fa28-48cb-be72-aa9b8b289928 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] Returning 404 to user: Volume 4e69401c-a996-467e-a995-f7ef4e715673 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:09.498057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1142263d-fa28-48cb-be72-aa9b8b289928 tempest-VolumesNegativeTest-479244465 tempest-VolumesNegativeTest-479244465-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4e69401c-a996-467e-a995-f7ef4e715673" status: 404 len: 109 microversion: 2.1 time: 0.039267 Oct 21 15:10:09.503978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 442/858] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Oct 21 15:10:09 2022] GET /compute/v2.1/os-volumes/4e69401c-a996-467e-a995-f7ef4e715673 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:09.546052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.547144 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:09.553868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.554805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.556116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.557416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.558137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.558827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.858819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:09.859311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:09.868418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.868418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.868418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.868418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:09.868819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:09.868922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:09.893156 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-30218842-e28d-4e3c-9f32-0abebb3cd3f0 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/ips" status: 200 len: 153 microversion: 2.20 time: 0.038162 Oct 21 15:10:09.897233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 443/859] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Oct 21 15:10:09 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 21 15:10:09.930937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:09.943891 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-51ccb63b-8170-4cea-8cfd-3b2f50b7a262 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1367 microversion: 2.1 time: 0.402619 Oct 21 15:10:09.944483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 417/860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:09 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:10.103030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:10.105716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:10.112510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.116889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.117444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.129932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.130803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.132034 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.162890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4bb01e8a-171f-4615-9522-9a781cbb87f4 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063907 Oct 21 15:10:10.163681 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 444/861] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:10:10 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:10.183442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:10.183848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:10.190357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.191202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.191736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.192673 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.193337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.194726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.269778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:10.281740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d72a4f24-9ac7-4164-ab1a-7b77fdfda07d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1606 microversion: 2.1 time: 0.105658 Oct 21 15:10:10.283232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 418/862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:10 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1606 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:10.325300 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd0142-c1a4-480c-9c84-114dea2d4a78", "name": "network-vif-deleted", "tag": "455afb50-1871-4c92-8e2c-a7238ea79181"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:10.347388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.349005 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.349657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.371424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] Creating event network-vif-deleted:455afb50-1871-4c92-8e2c-a7238ea79181 for instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 on hv-cinder-83608 Oct 21 15:10:10.376986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-cc0873eb-de53-48eb-8141-d51648e83cb2 req-ac396073-360c-482f-829a-121b56a7bee9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055160 Oct 21 15:10:10.377905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 445/863] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:10.969129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:10.969742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:10.978405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.985711 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.986198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:10.987135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:10.987593 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:10.988015 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.137352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:11.148279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bd85f3b5-f55f-4f0b-90fe-26b71ea52576 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1557 microversion: 2.1 time: 0.182792 Oct 21 15:10:11.148857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 419/864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:10 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:11.176342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:11.177414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:11.179660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:11.179795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:11.186345 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.186541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.187126 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.188507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.188655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.188763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.188866 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.189123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.189238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.189768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.189980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.190565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.231742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7fef30c4-1f79-4163-8b1b-615cf7fefa67 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059954 Oct 21 15:10:11.232489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 420/865] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:10:11 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 21 15:10:11.243740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:11.244268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:11.250688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.251284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.251689 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.252404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.252865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.253293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.295446 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d643c22a-738f-41aa-914d-324441ea5f8e tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126571 Oct 21 15:10:11.296763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 446/866] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:10:11 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:11.320648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:11.321428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:11.329434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.330022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.330462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.331341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.331796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.332218 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.357736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] HTTP exception thrown: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 is not attached to volume d63e227f-8981-429f-b5fc-3e4dd47b56e7 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Request method failure captured: Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments/d63e227f-8981-429f-b5fc-3e4dd47b56e7 HTTP/1.1 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrWhlIGZPe_6w82r5dms_qZOb8jR19ZNdp-cf1bMCSKK6YR9pfUs7AxautjaQXynS3lLkjeHvemfafG2d6Smi6pVkjxqDA-ksWAeEJg47UM9mb9KQ4Mcs4i_ZmN2X9v8uLQtsFzXjxuVt1z_B4u5RjxSJgjY1CifMQ2lErdu6prqEnE Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: a77531edf7224da8847bb5c9813ae7da Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:11.367721 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a77531edf7224da8847bb5c9813ae7da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: a77531edf7224da8847bb5c9813ae7da Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-TestMinimumBasicScenario-542255438-project Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 2f95a367dd3148f1b31363513af8b637 Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-TestMinimumBasicScenario-542255438-project Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:10:11.369319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 is not attached to volume d63e227f-8981-429f-b5fc-3e4dd47b56e7 Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'server_id': 'bc662f58-53e9-4c89-929e-0254f9bc3e38', 'id': 'd63e227f-8981-429f-b5fc-3e4dd47b56e7'} Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d63e227f-8981-429f-b5fc-3e4dd47b56e7. Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:11.370344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 is not attached to volume d63e227f-8981-429f-b5fc-3e4dd47b56e7 Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 is not attached to volume d63e227f-8981-429f-b5fc-3e4dd47b56e7 Oct 21 15:10:11.371736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:11.372788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Returning 404 to user: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 is not attached to volume d63e227f-8981-429f-b5fc-3e4dd47b56e7 {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:11.373414 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-bc737826-9998-4f2a-9220-521e328747f8 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments/d63e227f-8981-429f-b5fc-3e4dd47b56e7" status: 404 len: 154 microversion: 2.1 time: 0.134355 Oct 21 15:10:11.377283 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 421/867] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:10:11 2022] DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38/os-volume_attachments/d63e227f-8981-429f-b5fc-3e4dd47b56e7 => generated 154 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:11.384044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:11.384504 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:11.384979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:11.385372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lazy-loading 'fault' on Instance uuid 01fd0142-c1a4-480c-9c84-114dea2d4a78 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:11.458070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:11.467217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-561763a6-5b68-47dd-a1fe-11661b9f154a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 200 len: 1327 microversion: 2.1 time: 0.157252 Oct 21 15:10:11.467794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 447/868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:11 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:12.177366 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:12.178457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:12.185086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.187216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.187216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.187216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.187551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.187727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.212217 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lazy-loading 'flavor' on Instance uuid 81446523-b4b2-4105-b224-66ebb84e5660 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:12.497408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:12.498553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:12.508144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.508144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.508144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.508144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.508486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.508486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.511949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:12.522038 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 HTTP/1.1 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:10:12.523910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:10:12.525456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '01fd0142-c1a4-480c-9c84-114dea2d4a78'} Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:12.526510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:10:12.528085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:12.529626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:12.529626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b60e7b41-aad2-4251-8695-096d50f537c0 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 404 len: 111 microversion: 2.1 time: 0.036371 Oct 21 15:10:12.531010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 448/869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:12 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:10:12.536696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d214d1-0e41-47a1-8911-9b6b9bab49fc", "tag": "d835a37e-e47e-43a7-9a54-1d55d85ad6d4"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:12.548214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.549225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.549225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.561578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] Creating event network-changed:d835a37e-e47e-43a7-9a54-1d55d85ad6d4 for instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc on hv-cinder-83608 Oct 21 15:10:12.568455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-8bd6247b-d805-41d4-a382-71aab966b9ff req-6da6587f-3cc4-4e74-b71a-811d59bb2dab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035631 Oct 21 15:10:12.572454 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 449/870] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:12.583524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-60d48a27-6030-4d54-8dec-f9ee88e5ca33 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '.version_select at 0x7fd1e0faa820>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:12.771101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-60d48a27-6030-4d54-8dec-f9ee88e5ca33 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641899690" status: 202 len: 0 microversion: 2.1 time: 0.197364 Oct 21 15:10:12.772222 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 450/871] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Oct 21 15:10:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641899690 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:10:12.785450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:12.790267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:12.803587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9fe59a70-b98e-43bb-a73d-f239de3fcc3f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/action" status: 202 len: 0 microversion: 2.20 time: 0.629870 Oct 21 15:10:12.804882 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 422/872] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Oct 21 15:10:12 2022] POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:10:12.805912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.806426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.815911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:12.817039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:12.821812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.822578 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.823101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.823884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.826271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.826831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.827426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.828461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:12.829108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:12.831113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:12.882430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:10:13.055831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:13.065190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:13.066671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:13.067871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4c1ce57f-9b57-488b-9c4a-c1d3d68f25b1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.258688 Oct 21 15:10:13.070481 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 423/873] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:12 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:13.275469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2d13e058-b057-48fa-bdfb-19c926602b9c tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 204 len: 0 microversion: 2.1 time: 0.501854 Oct 21 15:10:13.276910 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 451/874] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:10:12 2022] DELETE /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:10:13.285568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:13.289988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:13.298330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:13.298889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:13.299331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:13.300051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:13.300508 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:13.300934 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:13.541381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:13.553532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0ea9bf66-8df2-4a00-bd62-d914ac7460ba tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1554 microversion: 2.1 time: 0.271486 Oct 21 15:10:13.554980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 424/875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:13 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:13.940181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-09cc9d97-b115-4d55-925a-9d7614a61e45 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: .version_select at 0x7fd1e0dac160>, body: {"keypair": {"name": "tempest-keypair-635443820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg1WJag86GGAzkOxjL+ss7X1FRBGJxK1vk3+N/W46HNzJPDbMcY1pHSaL0g7WI2JAoXXD+aVcYFhCk6smOEm06PKgSqPJ1CyOljvAyZXH9f7DaurPdJgBiQWMmQFmBFQQ=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:13.957369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-09cc9d97-b115-4d55-925a-9d7614a61e45 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for project 0025ac2cdc0f45dab742a02486307716. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:10:13.962816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-09cc9d97-b115-4d55-925a-9d7614a61e45 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for user 3418ee58bd51418d9594b98ed594f506 and project 0025ac2cdc0f45dab742a02486307716. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:10:14.050130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-09cc9d97-b115-4d55-925a-9d7614a61e45 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114205 Oct 21 15:10:14.056280 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 452/876] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:10:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:14.094922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:14.095538 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:14.101538 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:14.102009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:14.102453 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:14.103180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:14.103639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:14.104067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:14.122123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:14.276426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:14.284417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:14.289623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:14.289623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4a7adc54-0a3c-48bb-ad15-5dd29df6b4c9 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.196271 Oct 21 15:10:14.289623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 425/877] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:14 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:14.578902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:14.579630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:14.587508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:14.587985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:14.588411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:14.589092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:14.589545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:14.589965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:14.755348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:14.763732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-16f27aa0-88fa-4f12-bf33-8907b7967bce tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1554 microversion: 2.1 time: 0.188704 Oct 21 15:10:14.764291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 453/878] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:14 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:15.312942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:15.314009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:15.325099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:15.325518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:15.325959 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:15.326692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:15.327200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:15.327642 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:15.522898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:15.533739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:15.535298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:15.536533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-18244f75-5260-4291-9722-47f6282850e1 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.227862 Oct 21 15:10:15.537068 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 426/879] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:15 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:15.791333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:15.792442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:15.799630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:15.800388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:15.800844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:15.801540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:15.801989 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:15.802406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:15.835365 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc662f58-53e9-4c89-929e-0254f9bc3e38", "name": "network-vif-deleted", "tag": "ec944e0e-612e-4817-bd86-18a2f862bac2"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:15.845298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:15.845802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:15.846233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:15.858692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] Creating event network-vif-deleted:ec944e0e-612e-4817-bd86-18a2f862bac2 for instance bc662f58-53e9-4c89-929e-0254f9bc3e38 on hv-cinder-83608 Oct 21 15:10:15.863467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-443709c7-a302-4717-95c9-222c38fa965e req-a41c38fb-73c9-4d88-9a25-8f3e1f63f00f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032439 Oct 21 15:10:15.864116 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 427/880] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:15.868252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:15.876082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-831321f3-c616-4159-b4f1-cd0e8cfead53 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1512 microversion: 2.1 time: 0.092505 Oct 21 15:10:15.876642 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 454/881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:15 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:16.564600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:16.565930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:16.574085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:16.574562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:16.575040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:16.575737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:16.576190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:16.576615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:16.717227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:16.727114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:16.728720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:16.729953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cb4f5c43-6e82-4e63-ac6e-80768ef0cefd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.170598 Oct 21 15:10:16.730603 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 428/882] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:16 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:16.780585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1422689564", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ba9c68-98e6-41b9-b0e4-cb7cb4592b59"}], "security_groups": [{"name": "tempest-securitygroup--1069279975"}], "key_name": "tempest-keypair-635443820", "user_data": "}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:16.885527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] validate_networks() for [('21ba9c68-98e6-41b9-b0e4-cb7cb4592b59', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:10:16.900384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:16.901003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:16.909265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:16.909265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:16.909265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:16.909265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:16.909637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:16.909637 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:16.945872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:16.946352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:16.947008 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:16.948195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lazy-loading 'fault' on Instance uuid bc662f58-53e9-4c89-929e-0254f9bc3e38 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:17.007245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f95a367dd3148f1b31363513af8b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77531edf7224da8847bb5c9813ae7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:17.015118 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ff55fdfd-34a8-4d13-a579-658752089a34 tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 200 len: 1349 microversion: 2.1 time: 0.118798 Oct 21 15:10:17.015686 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 429/883] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:16 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 1349 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:17.398407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:10:17.398874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:10:17.399502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:10:17.400092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:10:17.400509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:10:17.410957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:17.411420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:17.412104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:17.412792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:17.413246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:17.413863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:17.437179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for project 0025ac2cdc0f45dab742a02486307716. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:10:17.437179 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Getting quotas for user 3418ee58bd51418d9594b98ed594f506 and project 0025ac2cdc0f45dab742a02486307716. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:10:17.447735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:10:17.450197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:10:17.672090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-07218c3d-88b0-45c7-a890-191a71db6e9c tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.895650 Oct 21 15:10:17.672932 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 455/884] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:10:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 21 15:10:17.685037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-63ff641e-3fb2-462e-ab3e-dc91f052f558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:17.685895 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-63ff641e-3fb2-462e-ab3e-dc91f052f558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:17.743459 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-63ff641e-3fb2-462e-ab3e-dc91f052f558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:17.751195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-63ff641e-3fb2-462e-ab3e-dc91f052f558 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1237 microversion: 2.1 time: 0.069981 Oct 21 15:10:17.752191 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 430/885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:17 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:17.756991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:17.762762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:17.765004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:17.765790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:17.766245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:17.766983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:17.767442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:17.767882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:17.914437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:17.923164 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:17.925002 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:17.926166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8372c6aa-8380-48d6-bee1-c3db40477117 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.173522 Oct 21 15:10:17.926767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 456/886] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:17 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:18.039658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:18.040289 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] [instance: bc662f58-53e9-4c89-929e-0254f9bc3e38] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:18.046545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.047095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.047523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:18.048206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.048658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.049074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:18.063975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] HTTP exception thrown: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Request method failure captured: Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 HTTP/1.1 Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrWhlIGZPe_6w82r5dms_qZOb8jR19ZNdp-cf1bMCSKK6YR9pfUs7AxautjaQXynS3lLkjeHvemfafG2d6Smi6pVkjxqDA-ksWAeEJg47UM9mb9KQ4Mcs4i_ZmN2X9v8uLQtsFzXjxuVt1z_B4u5RjxSJgjY1CifMQ2lErdu6prqEnE Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: a77531edf7224da8847bb5c9813ae7da Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:10:18.065671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77531edf7224da8847bb5c9813ae7da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a77531edf7224da8847bb5c9813ae7da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: a77531edf7224da8847bb5c9813ae7da Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542255438 Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-TestMinimumBasicScenario-542255438-project Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 2f95a367dd3148f1b31363513af8b637 Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-TestMinimumBasicScenario-542255438-project Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. Oct 21 15:10:18.067073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'bc662f58-53e9-4c89-929e-0254f9bc3e38'} Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:18.067797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. Oct 21 15:10:18.069001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:10:18.071336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Returning 404 to user: Instance bc662f58-53e9-4c89-929e-0254f9bc3e38 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:18.071336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-be32e78c-7676-4ee5-997d-83631d401fee tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38" status: 404 len: 111 microversion: 2.1 time: 0.031858 Oct 21 15:10:18.071336 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 431/887] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:18 2022] GET /compute/v2.1/servers/bc662f58-53e9-4c89-929e-0254f9bc3e38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:18.077012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-96c6b29a-5b63-4ed4-b00d-20554ddcc7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] Calling method '.version_select at 0x7fd1e0dacd30>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:18.190113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-96c6b29a-5b63-4ed4-b00d-20554ddcc7da tempest-TestMinimumBasicScenario-542255438 tempest-TestMinimumBasicScenario-542255438-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1027732448" status: 202 len: 0 microversion: 2.1 time: 0.116885 Oct 21 15:10:18.191069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 457/888] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Oct 21 15:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1027732448 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:10:18.773688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:18.774297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:18.780920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.781403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.781837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:18.782682 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.783142 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.783564 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:18.853315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:18.861161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7f1091ea-45b5-412a-9aa4-ab5f04326f12 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1241 microversion: 2.1 time: 0.091816 Oct 21 15:10:18.861716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 432/889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:18 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:18.952095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:18.952857 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:18.958890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.959433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.959866 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:18.961287 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:18.961797 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:18.962220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:19.096079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:19.104410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:19.105846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:19.107055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-09d792bc-7e54-487c-ba75-2b9c98878b51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.159527 Oct 21 15:10:19.107648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 458/890] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:18 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:19.883533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:19.884148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:19.890910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:19.891401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:19.891843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:19.892554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:19.893010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:19.893435 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:20.096162 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:20.107932 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7de3b6ba-f0c5-430d-90a3-48612d0b7246 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1233 microversion: 2.1 time: 0.228302 Oct 21 15:10:20.108500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 433/891] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:19 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1233 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:20.134961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:20.135678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:20.142122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:20.142707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:20.143209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:20.143968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:20.144523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:20.145031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:20.400351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:20.408722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:20.410154 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:20.411379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0d09a820-8637-45fb-95e9-d4fa88bcce87 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.280916 Oct 21 15:10:20.411924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 459/892] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:20 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:21.131625 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:21.134520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:21.142002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:21.142490 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:21.143279 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:21.143858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:21.144331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:21.144812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:21.214833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:21.223059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f3ed5a8a-e89f-48e0-af14-0b3804536291 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1233 microversion: 2.1 time: 0.095406 Oct 21 15:10:21.235587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 434/893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:21 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:21.437997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:21.439234 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:21.447972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:21.449993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:21.449993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:21.449993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:21.450497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:21.451006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:21.626476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:21.636397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:21.637848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:21.647441 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7020d52a-e943-4071-a929-b9fc49e8411b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.213645 Oct 21 15:10:21.648386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 460/894] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:21 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:10:22.250266 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:22.252315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:22.264663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:22.265087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:22.265728 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:22.266480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:22.266971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:22.267562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:22.336524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:22.344276 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-317b8ebb-6ee4-4de6-bd58-3abae6e2900e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1289 microversion: 2.1 time: 0.100013 Oct 21 15:10:22.344843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 435/895] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:22 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:22.673696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:22.674964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:22.681361 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:22.682060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:22.682730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:22.683626 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:22.684244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:22.684856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:22.837321 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:22.845952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:22.847432 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:22.848606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-efccc664-3e30-482a-b10b-ead1310f54af tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.178998 Oct 21 15:10:22.849238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 461/896] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:22 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:23.369048 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:23.369662 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:23.384063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:23.384565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:23.385002 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:23.385715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:23.386173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:23.386705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:23.472759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:23.482754 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5cd94845-1d88-4315-a996-64d3e5cec26b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1295 microversion: 2.1 time: 0.117805 Oct 21 15:10:23.484565 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 436/897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:23 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:23.875353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:23.875999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:23.882711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:23.883480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:23.883989 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:23.884762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:23.885310 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:23.885800 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:24.060760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:24.083740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:24.087339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:24.087480 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9a96be91-282c-44b6-9f6d-6dd7b9623224 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.216024 Oct 21 15:10:24.090819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 462/898] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:23 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:24.513287 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:24.513920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:24.524622 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:24.525115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:24.525553 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:24.526258 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:24.533073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:24.533573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:24.771719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:24.779889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-82d04cab-7bb0-4937-9e2c-21f1593dfbce tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.272570 Oct 21 15:10:24.801851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 437/899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:24 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:25.116406 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:25.118288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:25.124524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:25.125018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:25.125548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:25.126195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:25.126894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:25.127293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:25.339052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b183de63-5bed-470b-8997-cffd5acdcca4", "tag": "2658b06f-2d5a-453a-ae24-11cba806f4e3"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:25.350931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:25.352739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:25.353372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:25.377720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] Creating event network-changed:2658b06f-2d5a-453a-ae24-11cba806f4e3 for instance b183de63-5bed-470b-8997-cffd5acdcca4 on hv-cinder-83608 Oct 21 15:10:25.397111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-f6834893-1596-4387-9ef8-de468d2a9a52 req-70ce1b8c-00b1-4fdd-81b0-02a59bf5ba99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062802 Oct 21 15:10:25.399749 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 438/900] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:10:25.597145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:25.605889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:25.607543 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:25.609068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-98375719-fbc9-4b23-8b08-30e966083b4f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.496777 Oct 21 15:10:25.609637 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 463/901] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:25 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:25.804253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:25.804966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:25.811204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:25.811690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:25.812123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:25.812815 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:25.813268 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:25.813692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:26.091001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:26.108694 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1bd82fac-19b6-476a-982a-2942e044ae9a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.309155 Oct 21 15:10:26.110195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 439/902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:25 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:26.635197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:26.635871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:26.646045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:26.647011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:26.647533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:26.648358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:26.649186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:26.649761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:26.852553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:26.862335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:26.864849 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:26.867486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6f00f291-4697-4270-8206-5826b27430a3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.235667 Oct 21 15:10:26.886816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 464/903] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:26 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:27.133542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:27.134825 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:27.137778 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:27.146400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:27.150512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:27.150998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:27.151729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:27.152262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:27.154418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:27.311874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:27.319584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-363b87d6-16da-4634-834a-ecc983ca4f76 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.190281 Oct 21 15:10:27.320206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 440/904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:27 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:27.895254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:27.895912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:27.899841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:27.899841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=10 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:27.904541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:27.905022 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:27.905453 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:27.906199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:27.906712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:27.907130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:28.072309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:28.093396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:28.096093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:28.098194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f6eee2c9-fa75-44ec-b58f-2d307afa3d91 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.207672 Oct 21 15:10:28.099213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 465/905] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:27 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:28.344454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:28.345139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:28.348504 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:28.356011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:28.356503 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:28.357125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:28.358009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:28.358918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:28.359582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:28.578942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:28.588908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-43a2ffd9-a6db-4825-b930-c2718eb0a3f6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.250133 Oct 21 15:10:28.591542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 441/906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:28 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:29.128990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:29.129689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:29.136617 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:29.137172 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:29.137673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:29.138410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:29.138889 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:29.139312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:29.285306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:29.294897 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:29.296492 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:29.297653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7093b541-6707-4dce-b89a-db544708f506 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1744 microversion: 2.20 time: 0.172872 Oct 21 15:10:29.298387 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 466/907] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:29 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:29.612578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:29.613231 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:29.619916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:29.620587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:29.621041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:29.621767 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:29.622180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:29.622842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:29.763735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:29.771776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5245e703-1c2e-413c-82d5-5b0a459ec487 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.162971 Oct 21 15:10:29.772736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 442/908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:29 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:30.326276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:30.326906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:30.333418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:30.333900 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:30.334335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:30.335058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:30.335547 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:30.335973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:30.467924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:30.477328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:30.478807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:30.479979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1889afee-bca8-4f69-878f-3bdcd5540e31 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1744 microversion: 2.20 time: 0.157550 Oct 21 15:10:30.480551 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 467/909] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:30 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:30.796950 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:30.797753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:30.807150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:30.807614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:30.807940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:30.808813 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:30.809264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:30.809975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:30.946339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:30.954615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7f37e872-02d0-4a6d-8eaf-d46e2a1f4b3e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.162765 Oct 21 15:10:30.955219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 443/910] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:30 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:31.504631 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:31.505224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:31.513520 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:31.513931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:31.514358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:31.515073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:31.515527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:31.515947 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:31.519904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:31.656152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:31.664391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:31.666183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:31.667563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0a0eec0e-4311-4257-8d12-3393c4a04a60 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.166804 Oct 21 15:10:31.668307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 468/911] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:31 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:31.982193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:31.983736 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:31.996916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:31.997501 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:31.998006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:31.999016 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:31.999642 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:32.001034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:32.161332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b183de63-5bed-470b-8997-cffd5acdcca4", "name": "network-vif-plugged", "status": "completed", "tag": "2658b06f-2d5a-453a-ae24-11cba806f4e3"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:32.178189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:32.179000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:32.179590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:32.193409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] Creating event network-vif-plugged:2658b06f-2d5a-453a-ae24-11cba806f4e3 for instance b183de63-5bed-470b-8997-cffd5acdcca4 on hv-cinder-83608 Oct 21 15:10:32.203535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:32.207284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:32.209633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-1673f240-d15a-49c1-8e29-f24d474942dd req-6e591633-5757-46be-9f0a-cdd0abeeb14c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051579 Oct 21 15:10:32.212107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 469/912] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:32.214675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b27a2611-55f4-440d-908a-4953de9110d9 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.240651 Oct 21 15:10:32.221444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 444/913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:31 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:32.695762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:32.696467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:32.711699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:32.712801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:32.713470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:32.714349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:32.714984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:32.715584 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:32.870212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:32.883376 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:32.885202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:32.886586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a4a69460-1a87-4d43-9fa1-59873ec0952f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.195739 Oct 21 15:10:32.887169 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 470/914] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:32 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:33.247312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:33.248033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:33.255494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:33.256239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:33.256909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:33.258556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:33.259173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:33.259605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:33.431931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:33.439667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3b9cff32-e37f-43b4-b201-b4985da62bd7 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1363 microversion: 2.1 time: 0.196091 Oct 21 15:10:33.440754 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 445/915] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:33 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:33.918595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:33.919335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:33.931622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:33.932484 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:33.933490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:33.934970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:33.935718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:33.936370 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.119068 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:34.127716 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:34.129281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:34.130722 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-555d48e6-9e3f-4a27-a747-33dfdbaae2cb tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.219049 Oct 21 15:10:34.131489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 471/916] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:33 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:34.260550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "name": "network-vif-plugged", "status": "completed", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:34.271211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:34.275940 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:34.276833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.290174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] Creating event network-vif-plugged:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:10:34.311312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-d0a741f3-08ee-4b81-9cb1-fedab9437462 req-b89664cc-62ab-4edf-8754-febbd72c136e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039578 Oct 21 15:10:34.312010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 446/917] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:34.466922 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:34.467676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:34.475544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:34.477231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:34.477758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.478998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:34.480130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:34.480669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.625170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:34.639719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-003e840d-ba08-42a3-8b64-b6c6d9dbd224 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1549 microversion: 2.1 time: 0.170360 Oct 21 15:10:34.639719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 472/918] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:34 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:34.668610 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:34.669206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:34.675724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:34.676211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:34.676826 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.677704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:34.678327 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:34.679540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:34.784916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-02fa3dd4-8b43-4e78-b492-e44c58ac2e7e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123031 Oct 21 15:10:34.785503 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 447/919] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Oct 21 15:10:34 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:35.159854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:35.161140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:35.170324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:35.171766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:35.172471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:35.173062 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:35.173924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:35.174598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:35.175134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:35.719568 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:35.732783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:35.740488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:35.740488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b7fb5736-1874-4191-b12b-005c3c307637 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.580686 Oct 21 15:10:35.740488 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 473/920] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:35 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:36.404181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b183de63-5bed-470b-8997-cffd5acdcca4", "tag": "2658b06f-2d5a-453a-ae24-11cba806f4e3"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:36.415531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:36.416299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:36.416906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:36.430464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] Creating event network-changed:2658b06f-2d5a-453a-ae24-11cba806f4e3 for instance b183de63-5bed-470b-8997-cffd5acdcca4 on hv-cinder-83608 Oct 21 15:10:36.448255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-bf1006f9-9288-4e3a-803d-7304d58c3a85 req-dd49b0c0-0b5a-4f30-bc21-2c2ef4edc062 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047953 Oct 21 15:10:36.448966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 448/921] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:36.771108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:36.772001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:36.779792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:36.780528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:36.781228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:36.782170 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:36.782818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:36.783394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:37.037973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:37.037973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:37.040198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:37.040198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-58b581db-d9f0-445b-862f-e00527b560aa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.262311 Oct 21 15:10:37.040198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 474/922] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:36 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:37.122007 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:37.122922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:37.129948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:37.135443 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:37.136151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:37.137137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:37.137695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:37.139759 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:37.173395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:10:37.537980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f6a7609b-0225-4a51-86d2-591213e62c51 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 204 len: 0 microversion: 2.1 time: 0.419951 Oct 21 15:10:37.540219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 449/923] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:10:37 2022] DELETE /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:10:37.552130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:37.552955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:37.560157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:37.561289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:37.561909 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:37.562836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:37.576412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:37.577877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:37.789676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:37.802396 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e33e5d85-739c-41e8-a632-877de95ab587 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1579 microversion: 2.1 time: 0.254573 Oct 21 15:10:37.803799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 475/924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:37 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:38.060795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:38.062922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:38.078562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:38.079423 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:38.080498 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:38.081475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:38.082169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:38.082724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:38.260465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:38.271837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:38.274046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:38.275599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9053ccfc-dd3f-4fe8-a72e-00e12d984e62 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.226025 Oct 21 15:10:38.276158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 450/925] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:38 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:38.826385 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:38.827079 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:38.834217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:38.834787 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:38.836417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:38.837549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:38.838272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:38.838952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:39.120937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:39.120937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c8602501-2a42-403c-8974-67a2ef4a3d52 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1579 microversion: 2.1 time: 0.180635 Oct 21 15:10:39.120937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 476/926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:38 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1579 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:39.303628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:39.305441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:39.312066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:39.312619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:39.313124 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:39.313881 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:39.314396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:39.314918 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:39.470484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:39.484010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:39.486025 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:39.487531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c17ae1b6-1a81-478e-abff-81e21f4ad14a tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.187853 Oct 21 15:10:39.488169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 451/927] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:39 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:40.030077 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:40.031603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:40.049251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:40.051569 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:40.055207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:40.056225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:40.056782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:40.057443 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:40.175490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:40.185741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-97d074cd-04dd-458a-b346-9379c7cf3baf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1511 microversion: 2.1 time: 0.161919 Oct 21 15:10:40.207820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 477/928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:40 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:40.514418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:40.515808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:40.524113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:40.538115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:40.542906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:40.543931 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:40.544605 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:40.545640 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:40.554307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5259dd-4225-4de2-9782-ef2b6373a42f", "name": "network-vif-deleted", "tag": "3dafda79-f594-42a3-9926-a914f06e3f6f"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:40.587317 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:40.588085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:40.588690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:40.610524 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] Creating event network-vif-deleted:3dafda79-f594-42a3-9926-a914f06e3f6f for instance ac5259dd-4225-4de2-9782-ef2b6373a42f on hv-cinder-83608 Oct 21 15:10:40.624709 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-bbd9783e-8599-4e3a-82c0-4fd99c22a7e7 req-ff325f6c-67f2-40ba-9a2b-530e9a80b979 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074121 Oct 21 15:10:40.626749 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 478/929] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:40.865433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:40.875324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:40.877725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:40.879031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-25475bf4-2dfe-4ce4-9b66-04e0418153c7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.368657 Oct 21 15:10:40.879585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 452/930] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:40 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:41.212244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:41.213142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:41.222409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:41.238813 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:41.239462 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:41.240379 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:41.241072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:41.243212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:41.292874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:41.294197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:41.295313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:41.295929 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lazy-loading 'fault' on Instance uuid ac5259dd-4225-4de2-9782-ef2b6373a42f {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:10:41.344499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:41.372757 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5e7250c5-57bc-4eb8-bf69-dbcf12db709b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 200 len: 1230 microversion: 2.1 time: 0.165614 Oct 21 15:10:41.374792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 479/931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:41 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 1230 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:41.905545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:41.906192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:41.912894 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:41.914400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:41.915178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:41.916064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:41.916519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:41.920092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:42.159350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:42.171324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:42.173255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:42.174907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c749ce51-93ad-4f3b-9cc3-b23dcf11dd84 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.273401 Oct 21 15:10:42.204707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 453/932] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:41 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:42.396606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:42.398434 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:42.405674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:42.406592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:42.407239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:42.408117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:42.408738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:42.409373 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:42.445995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] HTTP exception thrown: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Request method failure captured: Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f HTTP/1.1 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrWKk2Inf_8nsXfevXIfo44kysYCUXmWiC--HQ6MZMLCXk0ASqPkAI-flS5unJRrGyuOjwFxIbruzqHusZCdT0LdNwsNlxyLgB_5v0ROqjVGc_3SY-E7bXK6rYzI96r06_Tob4CVbgjbAxeLCumZyKlMHyfbpQhRvLneSr5Otvdrvk8 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:10:42.447951 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57eb0443c72743c8b3ab016fdf5c9745", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-TestVolumeBootPattern-125156430 Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: f71ffc3d05d4470fa533cfd6f22184b2 Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:10:42.449428 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'ac5259dd-4225-4de2-9782-ef2b6373a42f'} Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:10:42.450242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:10:42.451782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:10:42.461639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Returning 404 to user: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:10:42.461639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4122dbbe-4963-4da4-ad10-8a3219a830ad tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 404 len: 111 microversion: 2.1 time: 0.057195 Oct 21 15:10:42.461639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 480/933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:42 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:10:42.575714 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-980989708", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1403498007", "security_groups": [{"name": "tempest-secgroup-smoke-1507373944"}], "block_device_mapping_v2": [{"uuid": "7ffb775c-f636-4559-b8af-890f92b4f8fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba5ce276-5178-4856-9bdd-bc914a7bfa6c"}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:42.719542 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] validate_networks() for [('ba5ce276-5178-4856-9bdd-bc914a7bfa6c', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:10:43.129421 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:10:43.130000 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:10:43.130332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:10:43.130801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:10:43.131213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:10:43.141652 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:43.142137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:43.142563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:43.143314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:43.143761 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:43.144181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:43.161343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:10:43.165385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for user f71ffc3d05d4470fa533cfd6f22184b2 and project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:10:43.205478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:43.206085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:43.213286 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:43.213783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:43.214213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:43.215001 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:43.215456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:43.215877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:43.223805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:10:43.226161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ffb775c-f636-4559-b8af-890f92b4f8fa',volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:10:43.370182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:43.379134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:43.380851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:43.382247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-25aa39fc-f5fb-45b9-a578-ac183628cb0c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.180391 Oct 21 15:10:43.382953 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 481/934] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:43 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:43.654517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-eb2d8edf-6af3-444f-89f2-05f5350900d7 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.082614 Oct 21 15:10:43.663019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 454/935] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:10:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:10:43.667611 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-72484189-a64c-49f6-a955-e66d00359de4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:43.668238 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-72484189-a64c-49f6-a955-e66d00359de4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:43.744026 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-72484189-a64c-49f6-a955-e66d00359de4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:43.750964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-72484189-a64c-49f6-a955-e66d00359de4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1094 microversion: 2.1 time: 0.088314 Oct 21 15:10:43.752665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 482/936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:43 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:44.409253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:44.410074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:44.417675 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:44.418166 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:44.418719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:44.419599 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:44.420408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:44.420880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:44.564227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:44.573245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:44.574794 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:44.575961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fbb343dc-a4f6-417c-98f1-0d28bfe8c685 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1739 microversion: 2.20 time: 0.170992 Oct 21 15:10:44.576521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 455/937] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:44 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:44.775404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:44.775934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:44.785326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:44.785801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:44.786228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:44.786946 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:44.787395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:44.787818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:44.848869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:44.856547 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cd250457-4ae5-4e71-928d-bc0db263417d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1144 microversion: 2.1 time: 0.085888 Oct 21 15:10:44.857102 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 483/938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:44 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:45.601813 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:45.602418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:45.609465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:45.609465 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:45.609822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:45.610515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:45.610999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:45.611429 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:45.739076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:45.749184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:45.750612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:45.751782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-04ae7db0-fff2-4c17-982e-389b02881a51 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1721 microversion: 2.20 time: 0.154129 Oct 21 15:10:45.752485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 456/939] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:45 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:45.880358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:45.881011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:45.888740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:45.892901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:45.892901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:45.892901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:45.892901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:45.893296 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:45.957000 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:45.965598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5a1ec1bb-6fef-476b-969e-2e6638178417 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1192 microversion: 2.1 time: 0.089242 Oct 21 15:10:45.966181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 484/940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:45 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:46.780022 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:46.780627 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:46.787102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:46.787581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:46.790123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:46.790123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:46.790123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:46.790123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:46.918163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:46.926418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:46.927883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:46.929202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e06175f9-d3a4-4f10-a089-96f34a534ba7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1721 microversion: 2.20 time: 0.152902 Oct 21 15:10:46.929766 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 457/941] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:46 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:10:46.989196 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:46.989837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:46.996522 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:46.996984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:46.997417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:46.998121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:46.998573 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:46.999013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:47.058743 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:47.066191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-32f9ab49-f57d-4750-a154-2bc8128f4ab2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1200 microversion: 2.1 time: 0.080877 Oct 21 15:10:47.066851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 485/942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:46 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:47.954875 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:47.955492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:47.962572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:47.963101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:47.963547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:47.964319 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:47.964799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:47.965261 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:48.090225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:48.091437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:48.098598 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:48.099308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:48.099930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:48.100877 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:48.101525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:48.102098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:48.156758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:48.165808 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:48.167314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:48.168500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5dc4acd9-4147-4035-b9a9-a0ff3211155d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1724 microversion: 2.20 time: 0.217579 Oct 21 15:10:48.169308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 458/943] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:47 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:48.174865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:48.182973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b7a21dd8-2913-4322-93fb-6ee5808e5f73 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1210 microversion: 2.1 time: 0.096555 Oct 21 15:10:48.183540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 486/944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:48 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:48.198796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20a97ca-69fb-4a96-855c-e714b865968c"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:48.201145 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:48.207452 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:48.208277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:48.208396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:48.209059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:48.209518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:48.210464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.129936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:49.131295 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:49.140506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.141372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.142033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.142941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.143563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.144344 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.165898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:49.172916 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-183b712f-33f6-4fdb-b30c-e0e3f90bd0da tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.049853 Oct 21 15:10:49.173658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 487/945] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:10:49 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:49.205912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:49.206540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:49.213548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.217289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.217289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.217289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.217289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.217671 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.310986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:49.366993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:49.367728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d5073844-9ca4-46fc-85de-241498396bbd tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.164876 Oct 21 15:10:49.368689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 488/946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:49 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:49.373433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e771a4b5-b5e4-4515-b6af-cf0a011cf96c", "tag": "43c1dcac-2dbe-49cd-af7e-a725c9841d55"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:49.384180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.384659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.385332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.387255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-951093f7-959d-418c-a8d2-e29f7f9f9b44 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.192847 Oct 21 15:10:49.388110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 459/947] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Oct 21 15:10:48 2022] POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments => generated 188 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 21 15:10:49.399790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] Creating event network-changed:43c1dcac-2dbe-49cd-af7e-a725c9841d55 for instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c on hv-cinder-83608 Oct 21 15:10:49.404894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-3019c88b-5e18-45ce-85bc-b9c3e838c670 req-1ca0abf9-03bc-4f6f-bb7f-e76070cc9cd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034820 Oct 21 15:10:49.405661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 489/948] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:49.759251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:49.767275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:49.767275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.767275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.767275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.768349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:49.768834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:49.769259 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:49.997135 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "name": "network-vif-unplugged", "status": "completed", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:50.031970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.032502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.033266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.046805 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.compute.server_external_events [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] Unable to find a host for instance 81446523-b4b2-4105-b224-66ebb84e5660. Dropping event network-vif-unplugged {{(pid=119358) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 21 15:10:50.048545 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-21239582-4078-48b4-aeba-117c3ba0746a req-2ffe4333-82b1-4205-b8de-a482919dac38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056720 Oct 21 15:10:50.049679 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 490/949] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 21 15:10:50.390936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:50.391619 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:50.398283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.398810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.399245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.399930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.400380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.400797 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.405065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ec8675e8-0e98-4d8b-812c-5614f557eb45 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments/b20a97ca-69fb-4a96-855c-e714b865968c" status: 202 len: 0 microversion: 2.20 time: 0.651185 Oct 21 15:10:50.405665 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 460/950] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Oct 21 15:10:49 2022] DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments/b20a97ca-69fb-4a96-855c-e714b865968c => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:10:50.470989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:50.470989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:50.478171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.478676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.482168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.482168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.482168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.482168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.526254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119357) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 21 15:10:50.545101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:50.552809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2fe08a07-86d6-4eca-b1ca-b22971a82440 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.165976 Oct 21 15:10:50.553368 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 491/951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:50 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:10:50.816793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-cc7eeb36-b17d-4349-a658-7c31d9f21b6b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/action" status: 202 len: 0 microversion: 2.20 time: 0.350299 Oct 21 15:10:50.817444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 461/952] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Oct 21 15:10:50 2022] POST /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:10:50.825847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:50.826452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:50.833146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.833702 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.834394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.835793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:50.836433 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:50.836990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:50.969717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:50.978693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:50.980085 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:50.981579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d09d1f1e-b3d6-412d-9f3b-155bce2dde63 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1672 microversion: 2.20 time: 0.159679 Oct 21 15:10:50.982127 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 492/953] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:50 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:51.040588 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f156b328-64a8-476a-a877-3bbf58497f85"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:10:51.043024 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:51.049350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:51.050117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:51.050795 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:51.051568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:51.052094 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:51.052586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:51.576834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:51.577444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:51.583845 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:51.584320 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:51.588913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:51.588913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:51.588913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:51.588913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:51.724888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:51.733091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b670653a-8fbe-4ccb-9420-cdaf02bd2ddf tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.160197 Oct 21 15:10:51.733656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 493/954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:51 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:51.818587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f698d82c-9084-417d-bb83-db269e571315 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "POST /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783006 Oct 21 15:10:51.819297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 462/955] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:10:51 2022] POST /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:10:52.007334 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:52.008508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:52.014935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:52.017401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:52.017401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:52.017401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:52.017401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:52.018008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:52.156565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:52.165409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:52.166921 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:52.168084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-92f6d892-d676-40ec-930e-051b852bd0b6 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1674 microversion: 2.20 time: 0.164943 Oct 21 15:10:52.168639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 494/956] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:52 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:52.757348 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:52.758598 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:52.765666 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:52.766148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:52.766582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:52.767380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:52.767757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:52.768179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:52.908438 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:52.916175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f469dc0f-7970-4926-bc36-edead7634d95 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.163085 Oct 21 15:10:52.916993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 463/957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:52 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:53.194653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:53.195912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:53.202195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:53.202697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:53.203136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:53.203821 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:53.204312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:53.204847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:53.338588 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:53.347304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:53.348744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:53.349905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-751ba732-f6bb-460d-862e-53c894f8a3cd tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.159442 Oct 21 15:10:53.350466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 495/958] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:53 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:53.939745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:53.940342 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:53.942350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:53.943057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=6 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:53.959731 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:53.960230 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:53.960789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:53.962265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:53.962747 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:53.963176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:54.201356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:54.210157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6ab6580e-f651-47d3-9d3e-658555bbf73b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.274235 Oct 21 15:10:54.223505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 464/959] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:53 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:54.375840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:54.376455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:54.379700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:54.388369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:54.388369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:54.388369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:54.388369 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:54.389313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:54.403152 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:54.577198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:54.588479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:54.590209 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:54.591574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-272d1985-4049-4757-9d1b-12f2baf7ae88 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.219886 Oct 21 15:10:54.592313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 496/960] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:54 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:55.234205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:55.239719 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:55.247695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:55.248280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:55.248791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:55.249577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:55.250117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:55.250805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:55.427392 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:55.438735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fe9a7cca-c9b3-4127-9ef9-fcdbb39429f5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.208996 Oct 21 15:10:55.454857 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 465/961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:55 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:55.619061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:55.619841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:55.631746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:55.632620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:55.633783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:55.634507 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:55.635004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:55.635437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:55.892110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:55.903439 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:55.910143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:55.911417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ed64d9fc-93d9-4bf5-a71a-7736fc24621d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.297692 Oct 21 15:10:55.911988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 497/962] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:55 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:56.465088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:56.466791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:56.475391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:56.476949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:56.477568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:56.480091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:56.480091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:56.480091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:56.662696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:56.672241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1842e7dd-d163-4352-9eb4-0830cfd9c93c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.212383 Oct 21 15:10:56.673640 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 466/963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:56 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:56.937541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:56.938254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:56.948858 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:56.949747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:56.950392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:56.951960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:56.952505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:56.953293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:57.112794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:57.123405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:57.124923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:57.126095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-515f352d-aa58-424f-92bf-e86a38f57c9c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.192619 Oct 21 15:10:57.126939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 498/964] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:56 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:57.696210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:57.697064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:57.699271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:10:57.704483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:57.705009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:57.705461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:57.708334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:57.708334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:57.708334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:57.881604 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:57.889671 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5f631819-1276-4348-9959-1c6db0f63f4c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.197919 Oct 21 15:10:57.890244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 467/965] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:57 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:58.153053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:58.153766 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:58.160572 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:58.161088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:58.161501 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:58.162212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:58.162680 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:58.163107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:58.317933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:58.328165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:58.329753 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:58.330964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bbee3560-3eee-442f-bcf3-d57c90b58f5d tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.182389 Oct 21 15:10:58.332093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 499/966] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:58 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:10:58.915755 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:58.917131 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:58.924460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:58.926377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:58.927249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:58.933452 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:58.933946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:58.934385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:59.099799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:59.110620 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fe2b317f-e9ee-4e90-b0ea-cc36cc0fd0d6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.200953 Oct 21 15:10:59.111229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 468/967] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:10:58 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:10:59.358398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:10:59.359668 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:10:59.365977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:59.366466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:59.367533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:59.368251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:10:59.368730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:10:59.369166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:10:59.556542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:59.566049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:59.567960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:10:59.569333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-82c9749a-f6ba-4aa4-aa4c-410ed6a392ab tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.215485 Oct 21 15:10:59.571328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 500/968] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:10:59 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:00.140010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:00.141541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:00.233310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:00.233310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:00.233310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:00.233310 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:00.233706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:00.233706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:00.345111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:00.353215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a5e9ce67-4d1f-4b3c-ab3d-2acd5fd1edfa tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.222475 Oct 21 15:11:00.365505 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 469/969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:00 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:11:00.595534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:00.596395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:00.603302 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:00.603888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:00.604327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:00.605045 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:00.605506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:00.605936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:00.752803 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:00.763146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:00.764872 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:00.766367 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a90c40aa-4187-4caf-bfec-08fab765fe5f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.174715 Oct 21 15:11:00.767012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 501/970] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:00 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:01.376522 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:01.377786 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:01.384403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:01.384920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:01.385550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:01.386486 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:01.386969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:01.399858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:01.539127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:01.547921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-202a87fe-6d9c-48f8-8d23-c2890d5fc211 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.175533 Oct 21 15:11:01.556730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 470/971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:01 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:01.795693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:01.796472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:01.803191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:01.803681 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:01.804120 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:01.805426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:01.805887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:01.806314 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:01.940251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:01.948785 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:01.950239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:01.951442 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5015c3cf-f398-4b3e-8041-e47619f3deb3 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.161346 Oct 21 15:11:01.952002 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 502/972] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:01 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:02.570581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:02.571372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:02.578219 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:02.578743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:02.579182 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:02.579920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:02.580375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:02.580884 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:02.607432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:UPDATE=9,nova_cell1:SELECT=87,nova_cell1:INSERT=4 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:02.730810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:02.739407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-5941d74d-fdb8-4300-b274-1e0de711f39f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.172059 Oct 21 15:11:02.739407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 471/973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:02 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:02.977973 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:02.978491 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:02.984924 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:02.985403 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:02.985832 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:02.986530 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:02.987009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:02.989468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:03.120866 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:03.128990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:03.134220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:03.134220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4f54661a-afaa-4985-8a5d-587e0a84e6c8 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.158618 Oct 21 15:11:03.134220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 503/974] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:02 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:03.761614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:03.762386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:03.769860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:03.770374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:03.770843 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:03.771617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:03.772107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:03.772535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:03.907082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:03.915636 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-3b3bd3f1-1940-4a69-94e0-5ff7e0e8af9f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.158027 Oct 21 15:11:03.916205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 472/975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:03 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:04.157523 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:04.158130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:04.164706 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:04.165184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:04.165616 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:04.166304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:04.166802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:04.167224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:04.302592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:04.311024 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:04.312448 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:04.313591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e1324952-5729-4bab-a985-ffec7a2cf612 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.160164 Oct 21 15:11:04.314242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 504/976] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:04 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:04.938405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:04.939062 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:04.945706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:04.946185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:04.946623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:04.947351 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:04.947812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:04.948241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:05.076486 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:05.084832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7e0ce175-4683-4e88-ab54-d0017a9070a4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.150299 Oct 21 15:11:05.085404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 473/977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:04 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:05.340682 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:05.341316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:05.348732 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:05.349520 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:05.350398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:05.351011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:05.351579 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:05.352161 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:05.496421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:05.499856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:05.504676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:05.506134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:05.507299 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b31d13d9-5637-4d80-a736-b7822848db73 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.171809 Oct 21 15:11:05.507955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 505/978] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:05 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:06.038194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:06.038832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:06.056846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.057480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.058109 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.058858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.059325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.059741 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.108119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:06.108927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:06.117400 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=70 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:06.119844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.120613 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.121255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.122151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.122850 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.123475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.183844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'services' on Instance uuid 41d214d1-0e41-47a1-8911-9b6b9bab49fc {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:11:06.290255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:06.298767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3d9abcc2-578b-4883-8c36-15f58d3ec3ba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.194509 Oct 21 15:11:06.301838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 506/979] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:06 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:06.545716 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-83f9842d-3ea3-4258-a72c-08b1f8707748 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments/f156b328-64a8-476a-a877-3bbf58497f85" status: 202 len: 0 microversion: 2.1 time: 0.511075 Oct 21 15:11:06.546669 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 474/980] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:11:06 2022] DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments/f156b328-64a8-476a-a877-3bbf58497f85 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:11:06.557011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:06.557643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:06.559069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:06.561740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:06.575115 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.575566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.576021 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.576747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.577392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.577829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.585363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.588108 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.589426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.590246 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:06.591283 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:06.592324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:06.628869 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1646a47b-dd15-4fd0-ab28-8bf3d630f8db tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077152 Oct 21 15:11:06.629852 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 475/981] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:06 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:06.723216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:06.733487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:06.735237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:06.736529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-49814008-ea5e-4724-8538-9d3f40476ecf tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.193970 Oct 21 15:11:06.744940 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 507/982] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:06 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:07.323278 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:07.324553 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:07.331299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.331871 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.332385 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.333181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.333709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.334382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.498533 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:07.511001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7e6c3ec4-aea0-45ef-8b57-12ff0ee39e0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.192718 Oct 21 15:11:07.511913 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 476/983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:07 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:07.642120 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:07.646394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:07.651115 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.651633 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.652140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.652840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.653298 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.653726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.685511 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fa19d03e-8920-4476-abaf-2b6f7eebb9f7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047920 Oct 21 15:11:07.686267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 508/984] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:07 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:11:07.758890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:07.759397 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:07.765603 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.766303 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.766851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.773892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.773892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.773892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.774845 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:07.774845 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:07.777864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.778356 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.779014 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.779726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:07.780349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:07.780946 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:07.794139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:11:07.915717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:07.925388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:07.927059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:07.928288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-9baa8d9c-3982-4318-b7a6-6eafab6d08b7 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.163525 Oct 21 15:11:07.928845 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 509/985] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:07 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:08.096963 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9f28d321-d72c-46c8-aad0-2b7f05915c60 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 204 len: 0 microversion: 2.1 time: 0.342660 Oct 21 15:11:08.097559 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 477/986] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:07 2022] DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:11:08.106748 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:08.107366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:08.113354 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.113837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.114267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.117123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.117123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.117123 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.249778 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:08.257525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-79a0b5d0-4ba7-4ccf-a71c-beaa0ab7a1d2 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1682 microversion: 2.1 time: 0.154863 Oct 21 15:11:08.258229 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 510/987] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:08 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:08.395619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "name": "network-vif-plugged", "status": "completed", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:08.406233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.406756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.407193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.419121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] Creating event network-vif-plugged:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:11:08.424430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-d80e6f15-362e-4d99-8d10-82bf1cba7edb req-fd184e60-2b91-407a-b89e-90e0cf0c808d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Oct 21 15:11:08.425059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 478/988] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:08.535648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:08.536297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:08.542647 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.543171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.543618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.544318 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.544793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.545477 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.677527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:08.686426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b6645455-b2e8-441f-aaea-ecf98b9f8f06 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.154591 Oct 21 15:11:08.687282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 511/989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:08 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:08.954152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:08.955240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:08.965948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.965948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.965948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:08.965948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:08.966371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:08.966371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:09.095264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:09.103328 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:09.104797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:09.106016 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b2621d0e-2150-41f8-9641-c511a6f29c29 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.156231 Oct 21 15:11:09.106500 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 479/990] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:08 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:09.280868 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:09.281542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:09.288067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:09.288620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:09.289553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:09.290246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:09.290735 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:09.291162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:09.423646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:09.433544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1d6749b4-dcf6-441f-ad0c-b943835bb588 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1682 microversion: 2.1 time: 0.156840 Oct 21 15:11:09.434352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 512/991] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:09 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:09.709996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:09.710658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:09.717582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:09.718063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:09.718494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:09.719240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:09.719691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:09.720114 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:09.858624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:09.866525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a6d635bf-1b65-4496-b5dc-c79233f2181c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.161043 Oct 21 15:11:09.867149 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 480/992] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:09 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:10.131632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:10.132276 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:10.141283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.144157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.144157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.144157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.144157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.144541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.282386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:10.291267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:10.292697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:10.294037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7a51a608-27c2-447e-914e-360ddc814fef tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.166358 Oct 21 15:11:10.294606 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 513/993] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:10 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:10.440546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e771a4b5-b5e4-4515-b6af-cf0a011cf96c", "name": "network-vif-plugged", "status": "completed", "tag": "43c1dcac-2dbe-49cd-af7e-a725c9841d55"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:10.450773 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.451192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.451624 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.464412 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] Creating event network-vif-plugged:43c1dcac-2dbe-49cd-af7e-a725c9841d55 for instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c on hv-cinder-83608 Oct 21 15:11:10.465048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:10.465659 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:10.469433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-787ecc4a-962d-48a2-8730-9926f063486f req-f1f2292a-06eb-405b-a3ac-7dbb45825e08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Oct 21 15:11:10.470023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 481/994] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:10.472364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.472846 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.473292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.473965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.474417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.474859 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.542288 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:10.550903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7489b3c9-8ca0-41f7-9ec3-9b37b8b96d94 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1614 microversion: 2.1 time: 0.089758 Oct 21 15:11:10.551709 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 514/995] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:10 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:11:10.890550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:10.891283 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:10.898220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.898976 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.899655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:10.900495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:10.901033 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:10.901466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.063923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d214d1-0e41-47a1-8911-9b6b9bab49fc", "name": "network-vif-deleted", "tag": "d835a37e-e47e-43a7-9a54-1d55d85ad6d4"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:11.080092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:11.080977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:11.082181 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.097904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] Creating event network-vif-deleted:d835a37e-e47e-43a7-9a54-1d55d85ad6d4 for instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc on hv-cinder-83608 Oct 21 15:11:11.103824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-e9c7ce16-4732-4fe2-8fc8-d9ab4a2a9886 req-8396f553-e85f-435f-92a5-a99f093b409e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043770 Oct 21 15:11:11.104818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 515/996] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:11.216137 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:11.224361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ea7ab445-5ba0-45dd-b2cb-39db160c5c26 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.338569 Oct 21 15:11:11.224971 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 482/997] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:10 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:11.321282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:11.321891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:11.328025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:11.328510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:11.328941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.329636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:11.330089 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:11.330509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.478490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:11.489155 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:11.490593 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:11.496076 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e7eddba0-14cc-4bd9-b906-1fd277456f52 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.179766 Oct 21 15:11:11.503796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 516/998] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:11 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:11.578886 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:11.579425 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:11.585994 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:11.587013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:11.587447 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.588329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:11.588777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:11.589364 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:11.679473 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:11.688439 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-e6968699-4561-4989-933d-b08f6ef1dc62 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1326 microversion: 2.1 time: 0.116085 Oct 21 15:11:11.688993 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 483/999] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:11 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:12.249265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:12.250140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:12.256416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.257168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.257855 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.258886 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.259527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.260167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.401208 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:12.409128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e59863d9-4c20-4958-a93b-a380eaba752f tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1266 microversion: 2.1 time: 0.163568 Oct 21 15:11:12.409694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 517/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:12 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:12.528165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:12.528777 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:12.535398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.535886 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.536341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.537023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.537478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.537916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.673692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:12.682683 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:12.684269 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:12.685627 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-509e80d9-a5ca-4195-8473-357ae5dce19c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1730 microversion: 2.20 time: 0.161460 Oct 21 15:11:12.686165 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 484/1001] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:12 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:12.712831 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:12.713444 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:12.719273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.719751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.720206 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.720894 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.721342 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.721760 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.754670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:12.755168 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:12.755653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:12.756096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lazy-loading 'fault' on Instance uuid 41d214d1-0e41-47a1-8911-9b6b9bab49fc {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:11:12.804879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb3641974744d83816b6f3ad7bb6f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77156a46a45648cd8cb0ea22ab0f04a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:12.813267 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2b223704-fc85-4645-be9d-297a056c1346 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 200 len: 1331 microversion: 2.1 time: 0.105235 Oct 21 15:11:12.813836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 518/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:12 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:13.432467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:13.433081 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:13.440011 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.440497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.440942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.441691 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.442085 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.442514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.577951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:13.585699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c289dbb4-f441-4429-bf00-4736fb69f422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1453 microversion: 2.1 time: 0.157668 Oct 21 15:11:13.586248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 485/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:13 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:13.608190 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:13.608804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:13.614890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.615378 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.615823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.617802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.618528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.618997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.712099 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:13.712725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:13.719301 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.719998 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.720444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.721173 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.721632 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.722061 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.775673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:13.785053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c0736c42-ab47-4434-852f-c94b4a03db58 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1453 microversion: 2.1 time: 0.181210 Oct 21 15:11:13.785978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 519/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:13 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:13.837349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:13.839205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:13.845341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.846157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.846728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.847563 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:13.848527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:13.849059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:13.867028 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc HTTP/1.1 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:13.870669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:13.872340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '41d214d1-0e41-47a1-8911-9b6b9bab49fc'} Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:13.873180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:13.874786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:13.876744 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:13.877380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3d6edc2f-373d-4703-93b6-992472e656d3 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 404 len: 111 microversion: 2.1 time: 0.044199 Oct 21 15:11:13.878478 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 520/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:13 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:11:13.891108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7c03390f-2304-41eb-90db-6eaee496faf7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '.version_select at 0x7fd1e0e194c0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:13.895951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:13.905643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:13.907178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:13.908853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-09d25117-0cd3-497b-8e26-781d7f298f6f tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1717 microversion: 2.20 time: 0.200971 Oct 21 15:11:13.910013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 486/1006] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:13 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:11:14.028615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7c03390f-2304-41eb-90db-6eaee496faf7 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715201941" status: 202 len: 0 microversion: 2.1 time: 0.145600 Oct 21 15:11:14.029407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 521/1007] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Oct 21 15:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715201941 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:11:14.567065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:14.573195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:14.575351 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:14.575838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:14.576407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:14.577110 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:14.577561 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:14.577983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:14.580601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:14.606001 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f508ed90-25cf-4ede-ad3c-c6dd978009e2 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/ips" status: 200 len: 145 microversion: 2.1 time: 0.301590 Oct 21 15:11:14.606563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 487/1008] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Oct 21 15:11:14 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/ips => generated 145 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:16.249414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e771a4b5-b5e4-4515-b6af-cf0a011cf96c", "tag": "43c1dcac-2dbe-49cd-af7e-a725c9841d55"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:16.260739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.262065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.262669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.277390 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] Creating event network-changed:43c1dcac-2dbe-49cd-af7e-a725c9841d55 for instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c on hv-cinder-83608 Oct 21 15:11:16.283252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-4a06c0d2-42b3-4f3e-aab8-cef7cdd4a689 req-47cd6462-89a4-4653-9d11-c2fd80b026df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038799 Oct 21 15:11:16.283852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 522/1009] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:16.326592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ef83e0e-c4b2-4a63-8039-bc20c1b5b401"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:16.329205 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:16.337714 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.339174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.339848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.340658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.341192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.341674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.562351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:16.563019 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:16.570792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.572450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.572450 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.572805 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.574564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.575551 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.591157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc HTTP/1.1 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:16.593097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.594479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '41d214d1-0e41-47a1-8911-9b6b9bab49fc'} Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:16.595552 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.596765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.602157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:16.602157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5d5855f2-6026-47c6-ba5b-bcecc08a17a6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 404 len: 111 microversion: 2.1 time: 0.036487 Oct 21 15:11:16.602157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 523/1010] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:16 2022] DELETE /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:11:16.603333 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:16.604717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 41d214d1-0e41-47a1-8911-9b6b9bab49fc] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:16.611566 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.612055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.613044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.613294 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:16.613717 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:16.614137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:16.630508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc HTTP/1.1 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:16.632210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.642863 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '41d214d1-0e41-47a1-8911-9b6b9bab49fc'} Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:16.644004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. Oct 21 15:11:16.645407 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:16.646761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 41d214d1-0e41-47a1-8911-9b6b9bab49fc could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:16.646761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-18ce453d-addd-4e19-86be-9bfe37870f99 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc" status: 404 len: 111 microversion: 2.1 time: 0.035036 Oct 21 15:11:16.646761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 524/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:16 2022] GET /compute/v2.1/servers/41d214d1-0e41-47a1-8911-9b6b9bab49fc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:17.158073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ce352877-781f-4533-978a-16e5ddb9083b tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835464 Oct 21 15:11:17.158608 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 488/1012] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:11:16 2022] POST /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:17.941185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:17.941686 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:17.948483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:17.948964 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:17.949391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:17.950078 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:17.950557 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:17.951008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:17.965482 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 HTTP/1.1 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:17.967661 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:17.969219 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'cb330ad8-3230-4a73-8657-b7ad0f3d7875'} Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:17.970097 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:17.971544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:17.972968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:17.972968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d7257ef0-e554-40f2-bb32-397b23c6402c tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 404 len: 111 microversion: 2.1 time: 0.031516 Oct 21 15:11:17.972968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 525/1013] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:17 2022] DELETE /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:17.977615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:17.978308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: cb330ad8-3230-4a73-8657-b7ad0f3d7875] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:17.986166 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:17.986668 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:17.987105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:17.987793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:17.988240 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:17.988658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:18.002523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 HTTP/1.1 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:18.004168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:18.005710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'cb330ad8-3230-4a73-8657-b7ad0f3d7875'} Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:18.006601 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. Oct 21 15:11:18.008111 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.009424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance cb330ad8-3230-4a73-8657-b7ad0f3d7875 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:18.009424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a6297a48-3abb-42ed-bfec-df0faff46e28 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875" status: 404 len: 111 microversion: 2.1 time: 0.032196 Oct 21 15:11:18.009424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 489/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:17 2022] GET /compute/v2.1/servers/cb330ad8-3230-4a73-8657-b7ad0f3d7875 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:18.014834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:18.015363 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:18.021309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:18.021789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:18.022227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:18.022952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:18.023411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:18.023879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:18.037780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 HTTP/1.1 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:18.039377 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.041052 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '54ed427f-9de0-4262-97b3-cd20818746e2'} Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:18.042688 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.044213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.045941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:18.045941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e54530b2-1422-456d-9c4b-55e34fb67bda tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 404 len: 111 microversion: 2.1 time: 0.030468 Oct 21 15:11:18.045941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 526/1015] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:18 2022] DELETE /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:18.051272 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:18.051883 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 54ed427f-9de0-4262-97b3-cd20818746e2] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:18.057835 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:18.058316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:18.058784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:18.059477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:18.059925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:18.060350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:18.073451 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 HTTP/1.1 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:18.074972 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.076513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '54ed427f-9de0-4262-97b3-cd20818746e2'} Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:18.078047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. Oct 21 15:11:18.079634 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:18.080920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 54ed427f-9de0-4262-97b3-cd20818746e2 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:18.080920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7bd94032-9498-4142-9eeb-1e89535d41d6 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2" status: 404 len: 111 microversion: 2.1 time: 0.028943 Oct 21 15:11:18.080920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 490/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:18 2022] GET /compute/v2.1/servers/54ed427f-9de0-4262-97b3-cd20818746e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:19.367460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:19.367985 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:19.374473 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:19.374997 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:19.375430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:19.376117 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:19.376570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:19.376991 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:19.391211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 HTTP/1.1 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:19.392738 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.394248 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '53221d88-6f22-49de-9589-94759df68635'} Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:19.395108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.396308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.397853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:19.397853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c4b2c59a-3531-4bdf-b9c2-43dc45feb6bd tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 404 len: 111 microversion: 2.1 time: 0.030624 Oct 21 15:11:19.397853 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 527/1017] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:19 2022] DELETE /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:19.402352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:19.403799 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] [instance: 53221d88-6f22-49de-9589-94759df68635] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:19.410228 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:19.410755 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:19.411197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:19.411891 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:19.412345 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:19.412769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:19.427846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] HTTP exception thrown: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Request method failure captured: Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 HTTP/1.1 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT1oslpDv4Uq3Q6ylTgTwuREGxCvaCebZLfVrd5Y0j6Z9evWFanze3NtTszl4PhY-8l0IGmwB9ZxnCWJLoqB1WXfQfw0NUgZ_NixJGCNSB3MeAjpgf0dzQ-0lCh2NoTrQnVrUCQJvfucajF3vRNZlmEJi6i33rIKi2LCJo-fIdqQrY Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:19.429430 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77156a46a45648cd8cb0ea22ab0f04a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77156a46a45648cd8cb0ea22ab0f04a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 77156a46a45648cd8cb0ea22ab0f04a8 Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-786356906 Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 1eb3641974744d83816b6f3ad7bb6f82 Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeNegativeTest-786356906-project Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.431006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '53221d88-6f22-49de-9589-94759df68635'} Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:19.431810 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. Oct 21 15:11:19.432967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:19.434043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] Returning 404 to user: Instance 53221d88-6f22-49de-9589-94759df68635 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:19.434043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-57c12402-c242-4b22-b955-2ef5dd62a355 tempest-AttachVolumeNegativeTest-786356906 tempest-AttachVolumeNegativeTest-786356906-project] 10.222.0.60 "GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635" status: 404 len: 111 microversion: 2.1 time: 0.032242 Oct 21 15:11:19.434043 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 491/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:19 2022] GET /compute/v2.1/servers/53221d88-6f22-49de-9589-94759df68635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:11:24.728903 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:24.731138 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:24.737905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:24.738326 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:24.738790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:24.739483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:24.739929 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:24.740392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:24.763311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=100 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:24.777796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d442569d-8aea-43bd-8188-3d79b96cfdca tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053063 Oct 21 15:11:24.778476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 528/1019] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:24 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:24.790803 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:24.791316 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:24.798592 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:24.799105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:24.799536 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:24.800224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:24.800674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:24.801097 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:24.832582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-aecb17ba-ba25-4769-96f8-54ad9ef28097 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401" status: 200 len: 194 microversion: 2.1 time: 0.045715 Oct 21 15:11:24.833171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 492/1020] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Oct 21 15:11:24 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:26.713096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8d2f798-7b05-46ba-8474-7be18b447b5b"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:26.716245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:26.722591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:26.723100 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:26.723536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:26.724224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:26.724683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:26.725104 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:27.643602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2753e058-857a-429b-b5a4-cc9bf18dee44 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "POST /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934791 Oct 21 15:11:27.644353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 529/1021] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:11:26 2022] POST /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:35.183863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:35.186031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:35.188552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:35.189856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:35.194520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.195034 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.195469 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.196152 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.196600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.197018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.227914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-012ab193-b52a-4f3a-a405-07baeb41d2ea tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047995 Oct 21 15:11:35.228450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 493/1022] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:35 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:35.366350 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:35.366911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:35.373864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.374351 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.374819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.375516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.375996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.376423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.406610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8da86f77-82ee-439e-8735-df55fab51a97 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401" status: 200 len: 194 microversion: 2.1 time: 0.045402 Oct 21 15:11:35.413790 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 530/1023] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Oct 21 15:11:35 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:35.418582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:35.419238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:35.427548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.428037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.428568 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.429204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:35.429665 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:35.430091 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:35.510550 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lazy-loading 'services' on Instance uuid b183de63-5bed-470b-8997-cffd5acdcca4 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:11:35.736802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9e0f69b9-8dda-485d-813d-14516220cccb tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401" status: 202 len: 0 microversion: 2.1 time: 0.321311 Oct 21 15:11:35.737555 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 494/1024] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:11:35 2022] DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/1ef83e0e-c4b2-4a63-8039-bc20c1b5b401 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:11:37.091391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:37.091993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:37.098856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:37.099347 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:37.099960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:37.100712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:37.101191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:37.101629 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:37.133998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2be8b537-bfb5-4060-b5e0-a766b2144af6 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/b8d2f798-7b05-46ba-8474-7be18b447b5b" status: 200 len: 194 microversion: 2.1 time: 0.046855 Oct 21 15:11:37.134690 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 531/1025] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Oct 21 15:11:37 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/b8d2f798-7b05-46ba-8474-7be18b447b5b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:37.146600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:37.147204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:37.154009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:37.154491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:37.154946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:37.155640 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:37.156101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:37.158115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:37.256844 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lazy-loading 'services' on Instance uuid b183de63-5bed-470b-8997-cffd5acdcca4 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:11:37.517200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c7b1343f-8ca7-4b0a-a677-c9ebeba25fda tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/b8d2f798-7b05-46ba-8474-7be18b447b5b" status: 202 len: 0 microversion: 2.1 time: 0.375238 Oct 21 15:11:37.518133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 495/1026] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:11:37 2022] DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments/b8d2f798-7b05-46ba-8474-7be18b447b5b => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:11:38.694430 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:38.696707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:38.699145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:38.703789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.704277 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.704786 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:38.705500 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.705957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.706383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:38.735841 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b7f11174-3bc5-4856-a532-e6e72477de71 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045326 Oct 21 15:11:38.736918 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 532/1027] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:38 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:11:38.859986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:38.859986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:38.865089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.865578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.866017 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:38.866739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.867195 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.867622 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:38.898357 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4370cbfd-6198-4852-b20e-861f05aa5f3f tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047185 Oct 21 15:11:38.898969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 496/1028] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Oct 21 15:11:38 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 21 15:11:38.967978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:38.971848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:38.980796 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.981397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.981754 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:38.982469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:38.982943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:38.983511 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:39.023733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:11:39.348451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0c7ba30c-fa31-4291-8323-c4730e0e0f66 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 204 len: 0 microversion: 2.1 time: 0.384999 Oct 21 15:11:39.349041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 533/1029] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:38 2022] DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:11:39.357098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:39.357710 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:39.363854 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:39.364338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:39.364775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:39.365468 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:39.365922 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:39.366344 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:39.500286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:39.508051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f10ba2f3-6f5f-46e5-b2a1-19476364317d tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1673 microversion: 2.1 time: 0.154790 Oct 21 15:11:39.508609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 497/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:39 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:40.532440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:40.534011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:40.540424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:40.540901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:40.541331 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:40.542011 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:40.542463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:40.542907 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:40.669503 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:40.679074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a76ff1fc-51be-4cac-a5df-d1684ca5a9a1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1673 microversion: 2.1 time: 0.150933 Oct 21 15:11:40.679641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 534/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:40 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:41.701453 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:41.702190 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:41.709092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:41.709574 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:41.710008 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:41.710729 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:41.711186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:41.711610 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:41.844623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:41.852720 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-72da4623-d067-4cf1-8a7b-61b7b2678d75 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1673 microversion: 2.1 time: 0.155180 Oct 21 15:11:41.853403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 498/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:41 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:42.140105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b183de63-5bed-470b-8997-cffd5acdcca4", "name": "network-vif-deleted", "tag": "2658b06f-2d5a-453a-ae24-11cba806f4e3"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:42.150483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:42.151235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:42.151662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:42.163241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] Creating event network-vif-deleted:2658b06f-2d5a-453a-ae24-11cba806f4e3 for instance b183de63-5bed-470b-8997-cffd5acdcca4 on hv-cinder-83608 Oct 21 15:11:42.174427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-45a94933-3dd5-455a-9c14-5fdbeb986325 req-7be8aff6-9aea-4ae3-a033-835e065a0bc7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 Oct 21 15:11:42.174427 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 535/1033] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:11:42.877426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:42.878027 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:42.884800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:42.885549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:42.885995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:42.886734 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:42.887252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:42.887633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:42.924614 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:42.925224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:42.926058 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:42.926518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lazy-loading 'fault' on Instance uuid b183de63-5bed-470b-8997-cffd5acdcca4 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:11:42.969381 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3418ee58bd51418d9594b98ed594f506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025ac2cdc0f45dab742a02486307716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:42.983937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-80c0349d-f03f-4528-be13-812741f65335 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 200 len: 1327 microversion: 2.1 time: 0.110468 Oct 21 15:11:42.984890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 499/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:42 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:44.009263 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:44.026017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:44.026017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:44.026017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:44.026017 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:44.026409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:44.026409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:44.026409 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:44.033505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 HTTP/1.1 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:44.035142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:44.036914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'b183de63-5bed-470b-8997-cffd5acdcca4'} Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:44.037965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:44.039553 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:44.040867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:44.040867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-10ae6fb2-6c72-4ca9-b430-259a2aec02fe tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 404 len: 111 microversion: 2.1 time: 0.031643 Oct 21 15:11:44.040867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 536/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:44 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:44.045743 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4d011396-dd76-47b8-9254-afd9187652f1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '.version_select at 0x7fd1e456fb80>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:44.102812 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4d011396-dd76-47b8-9254-afd9187652f1 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635443820" status: 202 len: 0 microversion: 2.1 time: 0.061018 Oct 21 15:11:44.103402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 500/1036] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Oct 21 15:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635443820 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:11:47.216010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:47.218195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:47.226029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.226499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.226959 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.227657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.228107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.228528 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.260012 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-177088a2-fee7-45bc-8e23-36ea2f6e0c8c tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048337 Oct 21 15:11:47.264707 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 537/1037] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Oct 21 15:11:47 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:11:47.324726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:47.325208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:47.334200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.334726 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.335174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.335887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.336346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.336781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.362141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:11:47.639772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:47.640273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:47.646622 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.647166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.647603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.648291 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.648746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.649171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.663110 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 HTTP/1.1 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:47.664639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.666141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'b183de63-5bed-470b-8997-cffd5acdcca4'} Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:47.667044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.668586 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.670213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:47.670213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-47378cd5-8baf-4a32-9d94-cb7b7fae590e tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 404 len: 111 microversion: 2.1 time: 0.030135 Oct 21 15:11:47.670213 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 538/1038] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:47 2022] DELETE /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:11:47.674084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:47.674721 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: b183de63-5bed-470b-8997-cffd5acdcca4] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:47.678420 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6efd64a1-d2d5-4b2a-bd32-86dfee5e0012 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 204 len: 0 microversion: 2.20 time: 0.357393 Oct 21 15:11:47.679197 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 501/1039] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Oct 21 15:11:47 2022] DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 21 15:11:47.680561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.683664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.683664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.683664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.683664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.684090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.691125 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:47.691839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:47.696822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 HTTP/1.1 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:47.698366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.699824 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'b183de63-5bed-470b-8997-cffd5acdcca4'} Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:47.703678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. Oct 21 15:11:47.704914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:47.709906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.710797 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance b183de63-5bed-470b-8997-cffd5acdcca4 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:47.710914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.710914 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.711160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5d30690d-38ea-428f-bf56-4f92b766706a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4" status: 404 len: 111 microversion: 2.1 time: 0.029446 Oct 21 15:11:47.711259 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:47.711363 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 539/1040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:47 2022] GET /compute/v2.1/servers/b183de63-5bed-470b-8997-cffd5acdcca4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 21 15:11:47.711456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:47.711456 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:47.848696 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:47.856980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:47.858417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:47.862762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-22070b5d-300a-42d0-93a8-1fdb3408264e tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.172866 Oct 21 15:11:47.862762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 502/1041] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:47 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 21 15:11:48.885437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:48.886869 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:48.892723 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:48.893211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:48.893693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:48.894389 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:48.895030 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:48.895457 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:48.994144 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:48.994692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:49.002006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:49.009957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:49.009957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:49.009957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:49.009957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:49.010484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:49.021983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 HTTP/1.1 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:49.023839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.025484 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '01fd0142-c1a4-480c-9c84-114dea2d4a78'} Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:49.026457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.027975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.031105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:49.031105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-20a3142f-f47e-4276-be5e-e91a8c885c4a tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 404 len: 111 microversion: 2.1 time: 0.035006 Oct 21 15:11:49.031105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 503/1042] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:11:48 2022] DELETE /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:49.040169 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:49.041183 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] [instance: 01fd0142-c1a4-480c-9c84-114dea2d4a78] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:49.047781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:49.048353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:49.048860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:49.049804 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:49.050330 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:49.050592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:49.051182 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:49.059799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:49.061243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:49.062421 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-c9384d87-e52a-46ad-9b84-f46e827ad023 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1723 microversion: 2.20 time: 0.180964 Oct 21 15:11:49.063983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 540/1043] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:48 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:49.082556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] HTTP exception thrown: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Request method failure captured: Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 HTTP/1.1 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrVQ-ZmJ52bC75fO2eB22FRSa7VV2ICfCv566o1TKHiQkWBJagbuqVjn-Klunz0tQAxCf2UPrEbVZzmrvtiOkQdKp_18D4HEHRxPfmqXHXlJjPEvoe4i_NGqhoZmA3sxIFwOU1Otg16zewiFnSvRev8T8FReA_QM6YGTn1oeDf2qTpM Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:49.084589 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0025ac2cdc0f45dab742a02486307716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0025ac2cdc0f45dab742a02486307716", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 0025ac2cdc0f45dab742a02486307716 Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118252150 Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 3418ee58bd51418d9594b98ed594f506 Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeTestJSON-2118252150-project Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.085925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '01fd0142-c1a4-480c-9c84-114dea2d4a78'} Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:49.086724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. Oct 21 15:11:49.087966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:49.089839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] Returning 404 to user: Instance 01fd0142-c1a4-480c-9c84-114dea2d4a78 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:49.089839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ba633366-af7b-4139-a94d-528eda5e0139 tempest-AttachVolumeTestJSON-2118252150 tempest-AttachVolumeTestJSON-2118252150-project] 10.222.0.60 "GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78" status: 404 len: 111 microversion: 2.1 time: 0.051817 Oct 21 15:11:49.089839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 504/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:11:49 2022] GET /compute/v2.1/servers/01fd0142-c1a4-480c-9c84-114dea2d4a78 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:11:49.997534 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81446523-b4b2-4105-b224-66ebb84e5660", "name": "network-vif-deleted", "tag": "fb085c36-5fbe-49ea-be0b-e8120d82509d"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:11:50.010086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:50.010567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:50.011015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:50.028058 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] Creating event network-vif-deleted:fb085c36-5fbe-49ea-be0b-e8120d82509d for instance 81446523-b4b2-4105-b224-66ebb84e5660 on hv-cinder-83608 Oct 21 15:11:50.034316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-aa9de215-37a8-446e-b781-e680213ad755 req-db833125-c55f-4540-ae7a-97644d18e9c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041054 Oct 21 15:11:50.036436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 541/1045] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:11:50.090616 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:50.092006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:50.102179 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:50.102991 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:50.103723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:50.104921 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:50.105556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:50.106441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:50.220353 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:50.230275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:50.232132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4593c3fd1739432fa57f4a94c65cd299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d10829a81437fb4d56fe488581212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:11:50.233510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ed567429-a107-428c-88c7-e35f0a372362 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 200 len: 1656 microversion: 2.20 time: 0.147754 Oct 21 15:11:50.235171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 505/1046] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:50 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 1656 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 21 15:11:51.277101 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:51.277801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:51.293490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:51.293830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:51.294486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:51.295517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:51.296640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:51.297281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:51.318144 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 HTTP/1.1 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:51.319876 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:51.321260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '81446523-b4b2-4105-b224-66ebb84e5660'} Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:51.322527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:51.323888 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:51.324972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:51.324972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5df3c330-b7e0-4fe9-af31-90a6f7294cce tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 404 len: 111 microversion: 2.20 time: 0.062051 Oct 21 15:11:51.324972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 542/1047] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:51 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:11:51.331415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1ac0d050-892c-416a-8474-b3145465708b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '.version_select at 0x7fd1e44e9ca0>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:51.435482 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1ac0d050-892c-416a-8474-b3145465708b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391642427" status: 204 len: 0 microversion: 2.20 time: 0.108881 Oct 21 15:11:51.436144 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 506/1048] 10.222.0.60 () {60 vars in 1259 bytes} [Fri Oct 21 15:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391642427 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 21 15:11:55.960497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:55.961583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:55.968502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:55.969032 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:55.969472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:55.970175 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:55.970662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:55.971094 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:55.993072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 HTTP/1.1 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:55.994700 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:55.996105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '81446523-b4b2-4105-b224-66ebb84e5660'} Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:55.996865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:55.998029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:55.999366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:55.999366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-42f9d186-1ada-4cb8-adc0-1d7aa4df8caa tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 404 len: 111 microversion: 2.20 time: 0.041266 Oct 21 15:11:55.999366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 543/1049] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Oct 21 15:11:55 2022] DELETE /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:11:56.007433 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:56.011473 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 81446523-b4b2-4105-b224-66ebb84e5660] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:56.020788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:56.021596 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:56.022384 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:56.023461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:56.024797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:56.025470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:56.051663 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 HTTP/1.1 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:56.054223 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:56.055762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '81446523-b4b2-4105-b224-66ebb84e5660'} Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:56.056489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. Oct 21 15:11:56.060434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:56.061494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 81446523-b4b2-4105-b224-66ebb84e5660 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:56.061494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-292c5da8-b206-4332-b50d-1deb75b13f78 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660" status: 404 len: 111 microversion: 2.20 time: 0.054922 Oct 21 15:11:56.061494 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 507/1050] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:55 2022] GET /compute/v2.1/servers/81446523-b4b2-4105-b224-66ebb84e5660 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:11:57.326902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:57.327380 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:57.333772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:57.334243 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:57.334696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:57.335666 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:57.336136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:57.336556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:57.339165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:11:57.351340 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd HTTP/1.1 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:11:57.352879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.354548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd'} Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:57.355610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.357053 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.358550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:57.358550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d2151abe-3d55-409c-a916-70d71854f174 tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 404 len: 111 microversion: 2.20 time: 0.031311 Oct 21 15:11:57.358550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 544/1051] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Oct 21 15:11:57 2022] DELETE /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:11:57.362887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:11:57.363497 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] [instance: 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:11:57.370546 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:57.371058 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:57.371491 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:57.372203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:11:57.372684 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:11:57.373107 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:11:57.386618 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] HTTP exception thrown: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Request method failure captured: Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd HTTP/1.1 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrT22UrP7rC3Rlv5K7o1tOivNL7_9zHGZdC32dWFKEl85KBYpJuVrhYfwKkzLvFJ876Tcsu80hrTAPec1qHquiWYXmYSmAhSbzTAM8JtdmfS8EX4QHxdahDZfvQbyLckwAoaWrpfhb9IvUgcuQAYXtllOtlIoVoIkEVigCgcaCOi0uk Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Openstack-Nova-Api-Version: 2.20 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:11:57.388150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c83d10829a81437fb4d56fe488581212"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c83d10829a81437fb4d56fe488581212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c83d10829a81437fb4d56fe488581212", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: c83d10829a81437fb4d56fe488581212 Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1042907547 Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 4593c3fd1739432fa57f4a94c65cd299 Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1042907547-project Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.389827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd'} Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:11:57.390957 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. Oct 21 15:11:57.392428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:11:57.393916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] Returning 404 to user: Instance 8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:11:57.393916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-0ac248e3-eee7-4ae5-8506-176f3c5dca7b tempest-AttachVolumeShelveTestJSON-1042907547 tempest-AttachVolumeShelveTestJSON-1042907547-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd" status: 404 len: 111 microversion: 2.20 time: 0.030613 Oct 21 15:11:57.393916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 508/1052] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Oct 21 15:11:57 2022] GET /compute/v2.1/servers/8f7b6ad4-f3ca-4e33-a8a0-e5d201c3f1fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 21 15:12:35.536770 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1347664445", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452"}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:12:35.545162 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:35.596914 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] validate_networks() for None {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:12:35.978615 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:12:35.979067 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:12:35.979548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:12:35.979963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:12:35.980493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:12:35.989459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:35.989976 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:35.990445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:35.991223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:35.991689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:35.992119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:36.009142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Getting quotas for project 3a5ca098647949a89a1d3d96ed6e5ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:12:36.013784 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Getting quotas for user b9d4cbdf1de0440a934d97916734338e and project 3a5ca098647949a89a1d3d96ed6e5ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:12:36.024762 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:12:36.027096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:12:36.140958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [0f0a9815-8d1c-49c3-895e-c9bf7d109007] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 21 15:12:37.150118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO oslo.messaging._drivers.impl_rabbit [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [0f0a9815-8d1c-49c3-895e-c9bf7d109007] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 38132. Oct 21 15:12:37.160438 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-78d3a5e1-c04d-448d-8770-5bfb1d541261 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626562 Oct 21 15:12:37.161084 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 545/1053] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:12:37.173694 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-02742173-fde2-460e-8909-e173f3767314 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:37.174340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-02742173-fde2-460e-8909-e173f3767314 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:37.176556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:37.177398 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:37.229841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-02742173-fde2-460e-8909-e173f3767314 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:37.237482 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-02742173-fde2-460e-8909-e173f3767314 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1215 microversion: 2.1 time: 0.068713 Oct 21 15:12:37.238047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 509/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:37 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:38.261521 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:38.267151 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:38.271199 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:38.271923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:38.272466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:38.273319 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:38.273893 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:38.274436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:38.345819 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:38.353805 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5ae1aa1b-81db-4a31-90b7-1e27f3d4067a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1219 microversion: 2.1 time: 0.097239 Oct 21 15:12:38.354397 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 546/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:38 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:39.378525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:39.379174 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:39.387680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:39.388260 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:39.388699 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:39.389399 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:39.389850 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:39.390277 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:39.452807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:39.460170 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-160c2b6c-aa84-40aa-99ea-a394ebd328bc tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1219 microversion: 2.1 time: 0.085949 Oct 21 15:12:39.460731 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 510/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:39 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:40.482715 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:40.483346 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:40.489904 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:40.490383 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:40.490878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:40.491567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:40.492023 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:40.492445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:40.558126 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:40.567339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f77a5777-e6b0-4333-b843-a9f1c4c1b16a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1267 microversion: 2.1 time: 0.088555 Oct 21 15:12:40.567912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 547/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:40 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:41.597920 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:41.599181 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:41.607758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:41.608658 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:41.609102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:41.611325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:41.611325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:41.612446 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:41.761260 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:41.770237 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-85d790d6-c2ef-4bee-8db1-e3a3aa5b3377 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.182007 Oct 21 15:12:41.771578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 511/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:41 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:42.586928 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596ff4f2-67c0-4332-8a20-3fb93089d346", "tag": "c6b0d1a6-0f83-4562-8741-989f44baca8a"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:12:42.596709 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:42.597332 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:42.597772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:42.609437 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] Creating event network-changed:c6b0d1a6-0f83-4562-8741-989f44baca8a for instance 596ff4f2-67c0-4332-8a20-3fb93089d346 on hv-cinder-83608 Oct 21 15:12:42.614725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-09b286ee-e734-4245-b244-2dc4f1f6ecd9 req-624b14bb-e445-49e5-a5dc-888cf58a429b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031943 Oct 21 15:12:42.615404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 548/1059] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:12:42.795087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:42.795954 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:42.802822 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:42.803343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:42.803780 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:42.804488 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:42.804949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:42.805378 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:42.937626 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:42.945583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9d41f1f2-f74e-4f4e-9fa5-83905b12c21a tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.155127 Oct 21 15:12:42.946150 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 512/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:42 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:43.969275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:43.969988 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:43.979391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:43.979391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:43.982726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:43.982726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:43.982726 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:43.983561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:44.119828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:44.128541 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-45a71b2c-28a5-48bf-9e42-e078cb0b84f1 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.164103 Oct 21 15:12:44.129132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 549/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:43 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:45.151782 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:45.152397 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:45.159730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:45.160216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:45.160656 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:45.161393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:45.161847 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:45.162270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:45.301983 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:45.310961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-583d1dba-bc41-475e-9914-a3ef3677bc91 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.162514 Oct 21 15:12:45.320841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 513/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:45 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:46.391618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:46.392341 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:46.396057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:46.396711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=6 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:46.400273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:46.400751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:46.401220 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:46.401911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:46.402358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:46.402807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:46.536657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:46.546019 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-57fc3231-1c21-4f56-beb2-f032215f40b0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.158371 Oct 21 15:12:46.546654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 550/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:46 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:47.569321 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:47.569853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:47.572192 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:12:47.577798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:47.578305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:47.578781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:47.579461 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:47.579908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:47.580324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:47.714093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:47.722457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-edf7c545-78a2-4c7f-afbe-f6e0ddc9370e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.156600 Oct 21 15:12:47.723012 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 514/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:47 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:48.746118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:48.746752 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:48.753678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:48.754157 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:48.754585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:48.755324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:48.755776 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:48.756194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:48.883564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:48.891327 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-65f297c3-5156-4b4f-924b-9f2e152881c0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.149978 Oct 21 15:12:48.891901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 551/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:48 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:49.913925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:49.914543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:49.921018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:49.921509 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:49.922733 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:49.923427 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:49.923885 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:49.924315 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:50.288253 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:50.295955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8d10887a-1153-4f95-82c8-51f980c5129f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.385821 Oct 21 15:12:50.296541 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 515/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:49 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:51.321620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:51.324471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:51.331254 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:51.331851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:51.332684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:51.333638 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:51.334207 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:51.334761 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:51.484191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:51.492008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-65653e11-e59f-472e-8ca8-4267840e02a0 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.176759 Oct 21 15:12:51.492887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 552/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:51 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:12:52.515308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:52.515980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:52.523311 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:52.523842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:52.524323 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:52.525095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:52.525598 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:52.526068 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:52.661776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:52.669547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-60aeb485-43c3-4940-85c8-cf0d236f8d96 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.157977 Oct 21 15:12:52.670105 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 516/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:52 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:53.527092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596ff4f2-67c0-4332-8a20-3fb93089d346", "name": "network-vif-plugged", "status": "completed", "tag": "c6b0d1a6-0f83-4562-8741-989f44baca8a"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:12:53.537273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:53.537742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:53.538239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:53.552235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] Creating event network-vif-plugged:c6b0d1a6-0f83-4562-8741-989f44baca8a for instance 596ff4f2-67c0-4332-8a20-3fb93089d346 on hv-cinder-83608 Oct 21 15:12:53.557246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-b3675efa-02ec-4e29-be07-5decbcc8b93b req-390172f6-29f4-4bbd-aeef-68d8369f2bfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Oct 21 15:12:53.557898 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 553/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:12:53.693657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:53.694376 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:53.701588 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:53.702172 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:53.702784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:53.703570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:53.704194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:53.704692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:53.878768 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:53.887912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b6500e6a-4ec9-42dd-8a05-032c0b4022f2 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.198169 Oct 21 15:12:53.888570 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 517/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:53 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:54.054683 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1117927494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1403498007", "security_groups": [{"name": "tempest-secgroup-smoke-1507373944"}], "block_device_mapping_v2": [{"uuid": "cd674e25-955e-4d3d-ad91-e24d66b7ed4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba5ce276-5178-4856-9bdd-bc914a7bfa6c"}]}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:12:54.173246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.network.neutron [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] validate_networks() for [('ba5ce276-5178-4856-9bdd-bc914a7bfa6c', None, None, None, None, None)] {{(pid=119358) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:12:54.554900 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:12:54.555483 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image limits 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:12:54.555820 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Flavor pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:12:54.556244 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Image pref 0:0:0 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:12:54.556652 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.virt.hardware [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:12:54.572192 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:54.572741 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:54.573315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:54.574338 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:54.575113 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:54.575733 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:54.593304 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:12:54.598057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Getting quotas for user f71ffc3d05d4470fa533cfd6f22184b2 and project 57eb0443c72743c8b3ab016fdf5c9745. Resources: {'instances', 'ram', 'cores'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:12:54.658003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Going to run 1 instances... {{(pid=119358) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:12:54.660467 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd674e25-955e-4d3d-ad91-e24d66b7ed4b',volume_size=None,volume_type=None)] {{(pid=119358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:12:54.911898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:54.912540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:54.919263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:54.919758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:54.920193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:54.920899 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:54.921380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:54.921806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:55.063065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:55.070784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fcf07c74-48a4-43f7-a8e0-bc463c2461ef tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1315 microversion: 2.1 time: 0.164036 Oct 21 15:12:55.071349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 518/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:54 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:12:55.113604 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-42ec7484-fea1-43b4-bb42-1a560551189c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063202 Oct 21 15:12:55.114177 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 554/1072] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:12:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:12:55.125265 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-543d5fa9-b126-47e9-b27c-f3bfbfd4e422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:55.125878 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-543d5fa9-b126-47e9-b27c-f3bfbfd4e422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:55.179988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-543d5fa9-b126-47e9-b27c-f3bfbfd4e422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:55.188051 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-543d5fa9-b126-47e9-b27c-f3bfbfd4e422 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1095 microversion: 2.1 time: 0.066262 Oct 21 15:12:55.188622 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 519/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:55 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:56.093986 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:56.095194 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:56.102823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.103550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.104160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.104867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.105517 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.105944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.212029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:56.212933 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:56.224926 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.225431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.226042 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.227059 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.227530 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.227961 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.255150 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:56.263105 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-151b080d-2c85-4dd1-99ca-4d0f50b6f99d tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1464 microversion: 2.1 time: 0.173440 Oct 21 15:12:56.263675 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 555/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:56 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:56.318648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:56.329855 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-70abf595-03c7-4288-bcd9-1fa01d86631d tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1145 microversion: 2.1 time: 0.122426 Oct 21 15:12:56.346178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 520/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:56 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:12:56.346393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:56.346393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:56.351576 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.352072 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.352873 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.353602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.354076 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.354495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.387782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:12:56.746485 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-016e7f15-8d02-4c69-929a-dbb6be3a3053 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "DELETE /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 204 len: 0 microversion: 2.1 time: 0.412808 Oct 21 15:12:56.749995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 556/1076] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:12:56 2022] DELETE /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 21 15:12:56.755706 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:56.756495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:56.762681 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.763171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.763612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.764329 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:56.764792 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:56.765424 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:56.902580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:56.911069 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f7dff7d9-2172-4adc-a9ad-2c0af0dff339 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1470 microversion: 2.1 time: 0.159500 Oct 21 15:12:56.911633 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 521/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:56 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:57.353936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:57.354660 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:57.361201 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:57.362874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:57.363313 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:57.364009 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:57.364463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:57.364885 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:57.427912 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:57.435687 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-98a8a229-2dbc-44ce-805f-5b64b01d472b tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1193 microversion: 2.1 time: 0.085970 Oct 21 15:12:57.436258 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 557/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:57 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:57.933718 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:57.937372 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:57.944391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:57.947193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:57.947193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:57.947193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:57.947193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:57.947689 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:58.129762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:58.137906 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-db7f0dbb-d27a-4bc5-a0a8-14020e627a9f tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1470 microversion: 2.1 time: 0.208422 Oct 21 15:12:58.138476 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 522/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:57 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:58.463636 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:58.464570 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:58.473654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:58.474279 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:58.474955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:58.475891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:58.476742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:58.477382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:58.555142 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:58.563353 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-3f33becd-d792-4ab8-bc8c-0cebf555f1e0 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1201 microversion: 2.1 time: 0.103832 Oct 21 15:12:58.565479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 558/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:58 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:59.119562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596ff4f2-67c0-4332-8a20-3fb93089d346", "name": "network-vif-deleted", "tag": "c6b0d1a6-0f83-4562-8741-989f44baca8a"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:12:59.139611 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:59.140280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:59.144479 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:59.161161 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] Creating event network-vif-deleted:c6b0d1a6-0f83-4562-8741-989f44baca8a for instance 596ff4f2-67c0-4332-8a20-3fb93089d346 on hv-cinder-83608 Oct 21 15:12:59.162665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:59.163349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:59.166908 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-d748d9ce-8d90-496e-9a8b-b107053c7fb6 req-cefdb215-f47f-4e64-8313-f4b55d5d692a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055054 Oct 21 15:12:59.173860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 523/1081] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:12:59.175122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:59.175122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:59.175122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:59.175122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:59.175533 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:59.185167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:59.259041 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:59.270400 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-83f94673-8aa3-49b8-bac1-3997ec066212 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1428 microversion: 2.1 time: 0.112724 Oct 21 15:12:59.272830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 559/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:59 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:12:59.592603 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:12:59.593390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:12:59.600239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:59.600802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:59.601654 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:59.602478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:12:59.603093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:12:59.606867 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:12:59.769208 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:12:59.777417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d41fc254-3bde-46a9-bd5c-f9cbfd76e065 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1279 microversion: 2.1 time: 0.189277 Oct 21 15:12:59.778096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 524/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:12:59 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:00.296086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:00.296693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:00.304188 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:00.304681 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:00.305119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:00.305823 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:00.306453 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:00.307069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:00.345233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:00.345745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:00.346529 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:00.347091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lazy-loading 'fault' on Instance uuid 596ff4f2-67c0-4332-8a20-3fb93089d346 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:13:00.410806 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d4cbdf1de0440a934d97916734338e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5ca098647949a89a1d3d96ed6e5ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:00.419091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1a8c8351-2b42-4b78-ba1d-8c62b9465840 tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 200 len: 1305 microversion: 2.1 time: 0.127073 Oct 21 15:13:00.419977 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 560/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:00 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:00.802294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:00.803015 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:00.809817 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:00.810298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:00.810756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:00.811502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:00.811949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:00.812369 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:00.951341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:00.959477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-34354057-2172-44fd-9915-9c46ab2039fc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.162302 Oct 21 15:13:00.960212 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 525/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:00 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:01.204646 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a6210f-fb73-4ce2-9f5f-442f242fc483", "tag": "53056fbf-6124-4329-a21d-d7fada81a1f6"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:01.215145 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:01.215830 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:01.216388 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:01.228783 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] Creating event network-changed:53056fbf-6124-4329-a21d-d7fada81a1f6 for instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 on hv-cinder-83608 Oct 21 15:13:01.233794 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-1f42d3e7-9bf2-4bc2-80a0-4401ffc19f28 req-db0c03fe-da9f-4e36-8ff6-4ae0d5be0018 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Oct 21 15:13:01.234746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 561/1086] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:13:01.444286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:01.444907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] [instance: 596ff4f2-67c0-4332-8a20-3fb93089d346] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:01.451066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:01.451551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:01.451986 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:01.452970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:01.453432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:01.453861 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:01.468221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] HTTP exception thrown: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Request method failure captured: Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 HTTP/1.1 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrbf6AwC6t828BeM67xFCB9usq6pYqALz5X_1_M3SSgO8LGE3MlasMJ77A16xecDtu4GsXaofNZGyzjLs0nMF66he9ENyGOZehbpA_xNGbP_g7HTKGqUsgG5LXsQ3J-i2Nm83ziOJf2PH3wXilE3VISBAdLsp6X1P7ooPPgDMSm1BiQ Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 3a5ca098647949a89a1d3d96ed6e5ed4 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesNegativeTest-187294794 Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:13:01.470014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a5ca098647949a89a1d3d96ed6e5ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3a5ca098647949a89a1d3d96ed6e5ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a5ca098647949a89a1d3d96ed6e5ed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3a5ca098647949a89a1d3d96ed6e5ed4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesNegativeTest-187294794 Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 3a5ca098647949a89a1d3d96ed6e5ed4 Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesNegativeTest-187294794 Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesNegativeTest-187294794-project Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: b9d4cbdf1de0440a934d97916734338e Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesNegativeTest-187294794-project Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. Oct 21 15:13:01.478831 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '596ff4f2-67c0-4332-8a20-3fb93089d346'} Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:13:01.480495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. Oct 21 15:13:01.482120 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:13:01.484775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] Returning 404 to user: Instance 596ff4f2-67c0-4332-8a20-3fb93089d346 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:13:01.484775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-44d641f5-3744-4fd2-9f90-dc4242d8660e tempest-VolumesNegativeTest-187294794 tempest-VolumesNegativeTest-187294794-project] 10.222.0.60 "GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346" status: 404 len: 111 microversion: 2.1 time: 0.032857 Oct 21 15:13:01.484775 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 526/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:01 2022] GET /compute/v2.1/servers/596ff4f2-67c0-4332-8a20-3fb93089d346 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:13:01.995459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:01.996354 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:02.010092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:02.010763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:02.011305 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:02.012128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:02.012816 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:02.013459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:02.178289 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:02.181384 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:02.187864 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-16355a78-b829-4f6d-95bf-97d04661d69e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.198090 Oct 21 15:13:02.188562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 562/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:01 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:03.212242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:03.212855 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:03.219255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:03.219737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:03.220232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:03.221401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:03.221867 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:03.222294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:03.358410 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:03.367531 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-608c2158-6626-4a46-b5f6-45f81f4dcd7e tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.159083 Oct 21 15:13:03.368095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 527/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:03 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:04.390739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:04.391391 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:04.399093 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:04.399669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:04.400111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:04.400939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:04.401278 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:04.401708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:04.544554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:04.553132 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-14b60f66-a871-44fe-bf0f-e2283f41ada6 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.166288 Oct 21 15:13:04.553697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 563/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:04 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:05.576178 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:05.576816 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:05.579445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:05.584994 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:05.585415 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:05.585851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:05.586539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:05.587019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:05.587445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:05.728121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:05.731597 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=100 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:05.736063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d38106ce-41bc-4bed-850a-19189ead4017 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.163793 Oct 21 15:13:05.736648 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 528/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:05 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:06.758952 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:06.759565 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:06.761410 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:06.762278 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=6 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:06.763446 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:06.768678 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:06.769140 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:06.769571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:06.774822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:06.774822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:06.774822 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:06.906459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:06.914184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-05102c44-f5a5-4fa3-9c6a-9df109ca7976 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.159211 Oct 21 15:13:06.914807 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 564/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:06 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:07.937341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:07.938068 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:07.945603 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:07.946082 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:07.946512 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:07.947233 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:07.947685 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:07.948104 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:08.100031 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:08.109684 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1eda3ad7-e6e0-4ef4-9a8b-bfc9daaea0de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.176332 Oct 21 15:13:08.110470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 529/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:07 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:09.133851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:09.134458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:09.141265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:09.141747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:09.142183 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:09.143178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:09.143632 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:09.144059 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:09.288469 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:09.296595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-77ad7e6f-ae3e-485e-b54b-216ef8738e91 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.167040 Oct 21 15:13:09.297165 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 565/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:09 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:13:10.321029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:10.321676 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:10.323995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=47 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:10.328655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:10.330554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:10.330554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:10.330554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:10.330907 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:10.331243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:10.467249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:10.476126 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-86631c74-83fe-4ae0-b668-2636f43ab420 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.158945 Oct 21 15:13:10.476680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 530/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:10 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:11.500164 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:11.500781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:11.512493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:11.512493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:11.512493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:11.512493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:11.513013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:11.513013 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:11.532851 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a6210f-fb73-4ce2-9f5f-442f242fc483", "name": "network-vif-plugged", "status": "completed", "tag": "53056fbf-6124-4329-a21d-d7fada81a1f6"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:11.544769 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:11.551154 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:11.555308 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:11.566058 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] Creating event network-vif-plugged:53056fbf-6124-4329-a21d-d7fada81a1f6 for instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 on hv-cinder-83608 Oct 21 15:13:11.571363 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-9a90f4c0-7a7b-43db-ab73-23bc71fec3a7 req-4da696a5-4361-47b0-b972-d58331c41a84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043382 Oct 21 15:13:11.571946 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 531/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:13:11.655251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:11.664652 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-23a5a17f-b02a-4fe3-9b2f-afbf81bd13e4 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.168853 Oct 21 15:13:11.665239 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 566/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:11 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:13:12.690211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:12.690915 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:12.697478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:12.698055 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:12.698489 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:12.699203 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:12.699655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:12.700077 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:12.837041 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:12.844928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-63e69cdc-cfe6-4022-a5c3-30afa3382397 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1267 microversion: 2.1 time: 0.159734 Oct 21 15:13:12.849532 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 532/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:12 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:13.868818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:13.869426 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:13.875900 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:13.876375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:13.877466 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:13.878156 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:13.878607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:13.879046 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:14.018136 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:14.026065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-77419632-0fa1-4408-b7b1-75d9aba81a7c tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1454 microversion: 2.1 time: 0.161384 Oct 21 15:13:14.026649 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 567/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:13 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:14.049377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:14.049990 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:14.056480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:14.056967 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:14.057400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:14.058096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:14.058551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:14.059036 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:14.194919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:14.206690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9d61bc19-98e4-49d0-8868-39d8b051ad0a tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1454 microversion: 2.1 time: 0.157720 Oct 21 15:13:14.206690 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 533/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:14 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:16.819261 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a6210f-fb73-4ce2-9f5f-442f242fc483", "tag": "53056fbf-6124-4329-a21d-d7fada81a1f6"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:16.833141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:16.833882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:16.834485 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:16.851975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] Creating event network-changed:53056fbf-6124-4329-a21d-d7fada81a1f6 for instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 on hv-cinder-83608 Oct 21 15:13:16.857833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-dbacf773-1536-42c3-90a7-ca6a9ac3cfd7 req-50349445-997d-4aef-9821-2b8ed960b84c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046653 Oct 21 15:13:16.858906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 568/1101] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:13:18.683635 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1862129387", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "networks": [{"uuid": "2d5026f2-f192-45f3-968a-7676a59e57d1"}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:18.740089 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] validate_networks() for [('2d5026f2-f192-45f3-968a-7676a59e57d1', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:13:19.085758 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:13:19.086234 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:13:19.086760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:13:19.087168 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:13:19.087578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:13:19.097056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:19.097470 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:19.097901 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:19.098649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:19.099101 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:19.099524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:19.116086 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Getting quotas for project e01624214b124e12a495c748e39dda48. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:13:19.120008 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Getting quotas for user a2d10cbd26b04ab88cdbd9ca4bb4b901 and project e01624214b124e12a495c748e39dda48. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:13:19.131255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:13:19.133518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:13:19.302709 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-06a7c282-ed35-4f49-9c38-c8f7a50901ac tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622843 Oct 21 15:13:19.303355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 534/1102] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:13:19.315070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-91dfc4c4-a573-48c7-9268-5f20510ba6ba tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:19.315779 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-91dfc4c4-a573-48c7-9268-5f20510ba6ba tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:19.370913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-91dfc4c4-a573-48c7-9268-5f20510ba6ba tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:19.378063 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-91dfc4c4-a573-48c7-9268-5f20510ba6ba tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1219 microversion: 2.1 time: 0.067254 Oct 21 15:13:19.378643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 569/1103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:19 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:20.401136 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:20.401752 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:20.408916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:20.409403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:20.409841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:20.410535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:20.411015 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:20.411441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:20.474450 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:20.485013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b43bc22c-deeb-4b0e-ad29-689429ecec47 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1223 microversion: 2.1 time: 0.087543 Oct 21 15:13:20.485607 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 535/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:20 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:21.513348 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:21.514048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:21.522901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:21.523031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:21.523718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:21.524099 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:21.524561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:21.524990 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:21.593958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:21.601926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b09075d0-3251-4725-9b3c-0fe9ea69b56b tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1279 microversion: 2.1 time: 0.092553 Oct 21 15:13:21.602502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 570/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:21 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:22.633403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:22.634046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:22.640723 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:22.641355 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:22.641796 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:22.643129 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:22.643598 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:22.644027 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:22.773571 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:22.781377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7e0e9c39-1270-4ac5-b1af-9ae3e6161177 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.152203 Oct 21 15:13:22.781947 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 536/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:22 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:23.112355 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038e1d7-65a2-4801-bea8-d5aa89f52469", "tag": "21152049-bcbc-4a8f-82d1-bdb6ee50a234"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:23.122509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:23.124486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:23.124486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:23.135148 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] Creating event network-changed:21152049-bcbc-4a8f-82d1-bdb6ee50a234 for instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 on hv-cinder-83608 Oct 21 15:13:23.140290 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-29041d22-01fe-491b-a748-a4e772213500 req-3b72f612-76b2-4f49-95ad-3c3e3cd2067d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032226 Oct 21 15:13:23.141098 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 571/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:13:23.805797 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:23.807141 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:23.814735 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:23.822585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:23.822585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:23.822585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:23.822585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:23.823019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:23.953175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:23.961754 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7234283e-3aa1-46c5-b873-cb44bedde2ab tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.160052 Oct 21 15:13:23.962337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 537/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:23 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:24.985008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:24.985718 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:24.993675 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:24.994167 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:24.994599 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:24.995375 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:24.995837 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:24.996258 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:25.130593 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:25.138246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4eca3bec-69c7-461f-ab7f-b74e065f84c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.157534 Oct 21 15:13:25.138852 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 572/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:24 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:26.161493 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:26.162014 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:26.168460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:26.168942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:26.169379 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:26.170064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:26.170518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:26.170975 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:26.299282 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:26.306874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4ae0e92c-65bf-41a5-aa56-5fdeb23b4eca tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.149465 Oct 21 15:13:26.307434 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 538/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:26 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:27.330516 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:27.331205 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:27.337656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:27.338130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:27.338561 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:27.339265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:27.339712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:27.340130 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:27.471758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:27.479536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fa4eabd4-c221-4596-9f05-34d5ddcac7f2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.153432 Oct 21 15:13:27.480119 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 573/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:27 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:28.504432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:28.505039 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:28.511428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:28.511900 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:28.512331 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:28.513009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:28.513457 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:28.513875 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:28.639582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:28.647838 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f631eb4a-da50-4d78-8cbc-f4a0ef64721c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.148103 Oct 21 15:13:28.648401 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 539/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:28 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:29.670577 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:29.671212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:29.673972 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:29.678984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:29.679411 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:29.679861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:29.680549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:29.681003 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:29.681425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:29.708523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0038e1d7-65a2-4801-bea8-d5aa89f52469", "name": "network-vif-plugged", "status": "completed", "tag": "21152049-bcbc-4a8f-82d1-bdb6ee50a234"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:29.714431 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:29.715317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=6 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:29.722356 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:29.723184 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:29.723305 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:29.734271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] Creating event network-vif-plugged:21152049-bcbc-4a8f-82d1-bdb6ee50a234 for instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 on hv-cinder-83608 Oct 21 15:13:29.740115 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-395b10b0-7dfe-408c-ad36-ef4bbbb8efcc req-eafba8df-e302-481f-b952-0ee8e5e52471 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036505 Oct 21 15:13:29.740845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 540/1113] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:13:29.819475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:29.827564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ec7f3ff6-3dcc-4ea2-b00e-8b4bded2a5f9 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.160886 Oct 21 15:13:29.828134 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 574/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:29 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:30.853113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:30.853814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:30.861925 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:30.862402 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:30.862865 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:30.863549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:30.863999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:30.864419 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:30.999076 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:31.006912 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-2d2f713d-1065-4fe7-b4de-7c150c1caab2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1319 microversion: 2.1 time: 0.158960 Oct 21 15:13:31.007469 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 541/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:30 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:32.029424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:13:32.030049 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:32.036871 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:32.037343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:32.037781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:32.038459 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:32.038943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:32.039365 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:32.168699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:13:32.177258 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-04f7ec39-3e50-47a6-a69b-3b82022e6c87 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1507 microversion: 2.1 time: 0.151850 Oct 21 15:13:32.177943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 575/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:13:32 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:13:47.832535 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad4dcc31-e31f-4f1c-ad86-ba7b0a437b72", "device": "/dev/sdb"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:13:47.835695 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:13:47.837989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:47.838760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=66 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:13:47.843562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:47.844044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:47.844476 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:47.845158 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:13:47.845602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:13:47.846021 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:13:48.589779 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-98528230-cbba-42b1-8a41-cae72b09138c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "POST /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761270 Oct 21 15:13:48.590393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 542/1117] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:13:47 2022] POST /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:14:14.207848 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:14.208366 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:14.210307 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=25 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:14.211118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=65 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:14.215630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:14.216115 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:14.216559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:14.217251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:14.217703 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:14.218126 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:14.434272 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lazy-loading 'services' on Instance uuid 0038e1d7-65a2-4801-bea8-d5aa89f52469 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:14:14.710424 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-caacef5e-dcec-49df-b4be-29b11a38e12c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469/os-volume_attachments/ad4dcc31-e31f-4f1c-ad86-ba7b0a437b72" status: 202 len: 0 microversion: 2.1 time: 0.506501 Oct 21 15:14:14.711275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 576/1118] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:14:14 2022] DELETE /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469/os-volume_attachments/ad4dcc31-e31f-4f1c-ad86-ba7b0a437b72 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:14:15.831639 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:15.832480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:15.836515 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:15.837122 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:15.843763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:15.845180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:15.845180 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:15.845416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:15.845805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:15.846224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:15.871807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:14:16.157236 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-ae5c77ba-3ab0-4b13-8a3e-9a47e8411a1d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 204 len: 0 microversion: 2.1 time: 0.326790 Oct 21 15:14:16.157742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 543/1119] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:14:15 2022] DELETE /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:14:16.167100 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:16.167730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:16.174269 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:16.174782 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:16.175217 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:16.175902 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:16.176398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:16.176772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:16.306487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:16.314141 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1331aafc-7384-4fd7-8117-951d600a7355 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1513 microversion: 2.1 time: 0.151922 Oct 21 15:14:16.314756 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 577/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:16 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:17.338171 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:17.338873 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:17.341564 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 21 15:14:17.341713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Fri Oct 21 15:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 (ip 10.222.0.60) !!! Oct 21 15:14:17.348952 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:17.349432 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:17.349862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:17.350552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:17.351035 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:17.351460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:17.534229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:17.542069 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-742bd6e8-ebc4-433f-8810-87101c1a32c4 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1513 microversion: 2.1 time: 0.208220 Oct 21 15:14:17.542687 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 544/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:17 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:14:18.264509 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0038e1d7-65a2-4801-bea8-d5aa89f52469", "name": "network-vif-deleted", "tag": "21152049-bcbc-4a8f-82d1-bdb6ee50a234"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:18.274198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:18.274696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:18.275118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:18.285764 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] Creating event network-vif-deleted:21152049-bcbc-4a8f-82d1-bdb6ee50a234 for instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 on hv-cinder-83608 Oct 21 15:14:18.290531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-8497f568-4728-4fa7-b6b9-442023d76c46 req-650db85c-bddf-45c1-9f5a-15c69f5242f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030320 Oct 21 15:14:18.291224 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 578/1122] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:14:18.567270 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:18.567849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:18.573910 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:18.577889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:18.577889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:18.577889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:18.577889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:18.578294 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:18.606292 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:18.606800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:18.607238 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:18.608307 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lazy-loading 'fault' on Instance uuid 0038e1d7-65a2-4801-bea8-d5aa89f52469 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:14:18.649337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:18.657239 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-245d408a-ac7c-4976-b752-d20ff5b1a9f7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 200 len: 1309 microversion: 2.1 time: 0.094038 Oct 21 15:14:18.657805 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 545/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:18 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:19.681818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:19.682582 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 0038e1d7-65a2-4801-bea8-d5aa89f52469] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:19.689696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:19.690174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:19.690602 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:19.691311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:19.691757 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:19.692178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:19.706324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] HTTP exception thrown: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Request method failure captured: Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 HTTP/1.1 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrcMM1zGt79ModLoRxYu1zr3yfO8MCkPCHGoHOjTFzQDNes4IJ6kSJ0heUkzDAZ-NuJZxLUye32dqaxQQOYuaWwTitxf1Oo6TlSbhlfqsHCa279K2w84RROnMtzCGamPLDHh2VN1qV9oJ0KDrUgq079jhiOQCg2kfeBosB4Gavv65k0 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: e01624214b124e12a495c748e39dda48 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:14:19.707963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e01624214b124e12a495c748e39dda48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e01624214b124e12a495c748e39dda48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e01624214b124e12a495c748e39dda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e01624214b124e12a495c748e39dda48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: e01624214b124e12a495c748e39dda48 Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-VolumesSnapshotTestJSON-44976353-project Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: a2d10cbd26b04ab88cdbd9ca4bb4b901 Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-VolumesSnapshotTestJSON-44976353-project Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. Oct 21 15:14:19.709423 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': '0038e1d7-65a2-4801-bea8-d5aa89f52469'} Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:14:19.710393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. Oct 21 15:14:19.712095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:19.713677 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Returning 404 to user: Instance 0038e1d7-65a2-4801-bea8-d5aa89f52469 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:14:19.713677 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cfe4b608-be47-4f01-9843-d2b61b135358 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469" status: 404 len: 111 microversion: 2.1 time: 0.032235 Oct 21 15:14:19.713677 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 579/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:19 2022] GET /compute/v2.1/servers/0038e1d7-65a2-4801-bea8-d5aa89f52469 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:14:30.099262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-499695530", "imageRef": "c522ad61-2c1a-4c67-840f-4daa0a419d68", "flavorRef": "452", "networks": [{"uuid": "2d5026f2-f192-45f3-968a-7676a59e57d1"}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:30.108478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:30.109185 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:30.156343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] validate_networks() for [('2d5026f2-f192-45f3-968a-7676a59e57d1', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:14:30.508753 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:14:30.509176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:14:30.509674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:14:30.510078 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:14:30.510483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:14:30.520003 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:30.520383 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:30.520806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:30.521526 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:30.521977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:30.522396 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:30.539898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Getting quotas for project e01624214b124e12a495c748e39dda48. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:14:30.543846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Getting quotas for user a2d10cbd26b04ab88cdbd9ca4bb4b901 and project e01624214b124e12a495c748e39dda48. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:14:30.555262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:14:30.560776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c522ad61-2c1a-4c67-840f-4daa0a419d68',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:14:30.650340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6df0ef25-2083-4cc9-b730-9fafb4333547 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554957 Oct 21 15:14:30.651063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 546/1125] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:14:30.662950 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-cd3e8625-94be-4284-914c-d8178ab126e1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:30.663556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-cd3e8625-94be-4284-914c-d8178ab126e1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:30.666519 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 21 15:14:30.666689 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Fri Oct 21 15:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 (ip 10.222.0.60) !!! Oct 21 15:14:30.667654 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=8 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:30.668322 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:30.728386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-cd3e8625-94be-4284-914c-d8178ab126e1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:30.736911 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-cd3e8625-94be-4284-914c-d8178ab126e1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1218 microversion: 2.1 time: 0.078001 Oct 21 15:14:30.737493 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 580/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:30 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:31.759960 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:31.760631 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:31.768009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:31.768493 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:31.770781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:31.770781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:31.770781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:31.770781 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:31.833879 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:31.841774 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-214c02bc-57d6-4069-bc79-bb63fb406900 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1222 microversion: 2.1 time: 0.086184 Oct 21 15:14:31.842523 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 547/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:31 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:32.864237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:32.864926 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:32.872048 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:32.872531 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:32.872966 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:32.873669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:32.874122 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:32.874550 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:32.936088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:32.944901 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-33ce9be8-26cc-4c50-9a1c-19f35eba456d tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1288 microversion: 2.1 time: 0.084567 Oct 21 15:14:32.958693 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 581/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:32 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:33.969980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:33.970590 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:33.977079 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:33.977545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:33.978037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:33.978784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:33.979243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:33.979672 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:34.112670 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:34.120441 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-31690b4b-6414-47a3-beb5-f6e1dfd8b2b1 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.154962 Oct 21 15:14:34.121004 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 548/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:33 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:34.179620 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bef36e-e878-4904-8240-bf56058caa55", "tag": "6c3bdb24-d3da-4d89-9e94-76797c9519c1"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:34.190323 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:34.190829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:34.191253 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:34.210265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] Creating event network-changed:6c3bdb24-d3da-4d89-9e94-76797c9519c1 for instance 36bef36e-e878-4904-8240-bf56058caa55 on hv-cinder-83608 Oct 21 15:14:34.210265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-4f4363db-b663-4069-a069-88c4664a0c88 req-5210d483-44cb-4855-ad80-ac80c670770d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032540 Oct 21 15:14:34.210265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 582/1130] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:14:35.144587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:35.145133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:35.151467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:35.151956 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:35.152425 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:35.153121 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:35.153579 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:35.154009 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:35.280902 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:35.288573 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b010f554-b879-4b81-947c-4591382e9d2c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.148720 Oct 21 15:14:35.289132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 549/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:35 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:36.312836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:36.313679 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:36.319996 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:36.320471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:36.320927 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:36.321607 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:36.322055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:36.322472 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:36.448044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:36.455641 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d10f753e-31ad-4327-a8ec-f4eda1d405bd tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.147634 Oct 21 15:14:36.463887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 583/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:36 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:37.484210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:37.484807 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:37.491324 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:37.491801 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:37.492232 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:37.492924 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:37.493375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:37.493793 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:37.622612 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:37.630660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c87fd498-aa23-4363-b5ed-fdb4a4e155c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.150289 Oct 21 15:14:37.631218 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 550/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:37 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:38.653701 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:38.654245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:38.661812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:38.662286 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:38.662746 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:38.663436 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:38.663890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:38.664312 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:38.792029 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:38.799939 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-7f15539f-8f49-46d8-b1b6-86c024c84e8a tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.150184 Oct 21 15:14:38.800506 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 584/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:38 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:39.821928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:39.822485 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:39.828814 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:39.829293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:39.829725 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:39.830407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:39.830889 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:39.831314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:39.953839 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bef36e-e878-4904-8240-bf56058caa55", "name": "network-vif-plugged", "status": "completed", "tag": "6c3bdb24-d3da-4d89-9e94-76797c9519c1"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:39.966086 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:39.966556 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:39.967004 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:39.968280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:39.977139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-920a3ed9-70e3-45b0-ab15-cb4629064c7c tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.159020 Oct 21 15:14:39.977718 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 551/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:39 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:39.981227 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] Creating event network-vif-plugged:6c3bdb24-d3da-4d89-9e94-76797c9519c1 for instance 36bef36e-e878-4904-8240-bf56058caa55 on hv-cinder-83608 Oct 21 15:14:39.995847 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-6a540c65-181f-47bd-8655-741a91c32490 req-d1f4ee87-027b-4af7-955c-e606152db5ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047033 Oct 21 15:14:39.996445 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 585/1136] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:14:41.001705 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:41.002317 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:41.004201 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:41.004870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=6 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:41.010133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:41.010619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:41.012146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:41.012146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:41.012352 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:41.012649 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:41.155122 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:41.164254 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1d543d04-0d54-416e-b011-4b15a879a827 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1318 microversion: 2.1 time: 0.167152 Oct 21 15:14:41.165304 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 552/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:40 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:42.185070 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:14:42.190451 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:42.196536 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:42.197143 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:42.197625 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:42.198055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:42.198840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:42.199292 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:42.199711 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:42.328669 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:42.336765 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5a70138d-4fdb-4f98-8993-cc8da4b7f0f8 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1506 microversion: 2.1 time: 0.152642 Oct 21 15:14:42.337325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 586/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:42 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:42.361112 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3013dc65-43fb-421d-aac0-94869b8af169", "device": "/dev/sdb"}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:42.363713 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:42.370244 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:42.370762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:42.371275 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:42.371966 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:42.372413 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:42.372836 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:42.995251 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-50814e88-6301-44aa-9fa7-da8954a7b852 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "POST /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.638389 Oct 21 15:14:42.999732 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 553/1139] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Oct 21 15:14:42 2022] POST /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:14:47.635576 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:47.636096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:47.642968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:47.643463 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:47.644425 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:47.645335 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:47.645804 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:47.647121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:47.673697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:14:47.695521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a6210f-fb73-4ce2-9f5f-442f242fc483", "tag": "53056fbf-6124-4329-a21d-d7fada81a1f6"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:47.705194 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:47.705833 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:47.706572 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:47.718446 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] Creating event network-changed:53056fbf-6124-4329-a21d-d7fada81a1f6 for instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 on hv-cinder-83608 Oct 21 15:14:47.724702 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-afe428de-eff3-4b45-a72c-d79564ce5bd9 req-fa922994-f2d1-42f5-97ee-5782b1abe2d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097263 Oct 21 15:14:47.725522 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 554/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:14:48.031137 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-53b31185-6d73-4628-95db-60b44dc7b4fe tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 204 len: 0 microversion: 2.1 time: 0.406714 Oct 21 15:14:48.031915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 587/1141] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:14:47 2022] DELETE /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:14:48.040548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:48.041255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:48.047562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:48.048049 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:48.048483 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:48.049454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:48.050216 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:48.051010 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:48.197733 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:48.205524 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a3445bc0-a292-4e25-81b3-2ba3a169a237 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1579 microversion: 2.1 time: 0.169018 Oct 21 15:14:48.206160 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 555/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:48 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:49.231548 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:49.232282 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:49.238984 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:49.239468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:49.239906 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:49.240595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:49.241047 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:49.241470 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:49.374266 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:49.382943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-15a8e3aa-55ec-462e-ac5f-855c8be8a075 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1579 microversion: 2.1 time: 0.155654 Oct 21 15:14:49.383520 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 588/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:49 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:50.407263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:50.407892 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:50.415576 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:50.416102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:50.416563 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:50.417349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:50.417847 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:50.418350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:50.560133 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:50.569510 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6bd32bd8-ab5d-467b-b0e4-fbf89f68a369 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1460 microversion: 2.1 time: 0.166140 Oct 21 15:14:50.570575 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 556/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:50 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1460 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:50.621514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a6210f-fb73-4ce2-9f5f-442f242fc483", "name": "network-vif-deleted", "tag": "53056fbf-6124-4329-a21d-d7fada81a1f6"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:50.632712 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:50.633182 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:50.633603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:50.648018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] Creating event network-vif-deleted:53056fbf-6124-4329-a21d-d7fada81a1f6 for instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 on hv-cinder-83608 Oct 21 15:14:50.653293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-b7da19e2-c36a-40c5-b0d7-5a954975c636 req-2a572457-6dce-4572-b613-546ed121d1e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037129 Oct 21 15:14:50.653892 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 589/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 21 15:14:51.593230 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:51.593995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:51.602694 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:51.603198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:51.603643 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:51.604347 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:51.605062 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:51.605582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:51.640802 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:51.641284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:51.641712 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:51.642148 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.objects.instance [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lazy-loading 'fault' on Instance uuid a6a6210f-fb73-4ce2-9f5f-442f242fc483 {{(pid=119357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:14:51.683211 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:51.690909 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-b4bf8a54-5bee-48cb-9cbe-6007ba709601 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 200 len: 1231 microversion: 2.1 time: 0.101527 Oct 21 15:14:51.691466 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 557/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:51 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:52.714260 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:52.714978 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: a6a6210f-fb73-4ce2-9f5f-442f242fc483] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:52.721674 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:52.722176 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:52.722603 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:52.723308 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:52.723755 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:52.724174 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:52.737780 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] HTTP exception thrown: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Request method failure captured: Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 HTTP/1.1 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrWKk2Inf_8nsXfevXIfo44kysYCUXmWiC--HQ6MZMLCXk0ASqPkAI-flS5unJRrGyuOjwFxIbruzqHusZCdT0LdNwsNlxyLgB_5v0ROqjVGc_3SY-E7bXK6rYzI96r06_Tob4CVbgjbAxeLCumZyKlMHyfbpQhRvLneSr5Otvdrvk8 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:14:52.739415 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57eb0443c72743c8b3ab016fdf5c9745", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-TestVolumeBootPattern-125156430 Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: f71ffc3d05d4470fa533cfd6f22184b2 Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. Oct 21 15:14:52.741160 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'a6a6210f-fb73-4ce2-9f5f-442f242fc483'} Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:14:52.742306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. Oct 21 15:14:52.743967 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:14:52.745510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Returning 404 to user: Instance a6a6210f-fb73-4ce2-9f5f-442f242fc483 could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:14:52.745510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d09aca05-d569-42d7-919f-5fb099bc76de tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483" status: 404 len: 111 microversion: 2.1 time: 0.030754 Oct 21 15:14:52.745510 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 590/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:52 2022] GET /compute/v2.1/servers/a6a6210f-fb73-4ce2-9f5f-442f242fc483 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:14:58.199680 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:58.200738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:58.202560 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e771a4b5-b5e4-4515-b6af-cf0a011cf96c", "tag": "43c1dcac-2dbe-49cd-af7e-a725c9841d55"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:14:58.208063 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:58.212047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:58.212047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:58.212047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:58.212047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:58.212391 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:58.213446 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:58.214008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:58.214672 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:58.226944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] Creating event network-changed:43c1dcac-2dbe-49cd-af7e-a725c9841d55 for instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c on hv-cinder-83608 Oct 21 15:14:58.232677 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-d0980c6a-49e6-407d-958b-6ba8e54b1449 req-e7584704-d1bb-436c-9fe0-6d7673dad4ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 Oct 21 15:14:58.233395 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 591/1148] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:14:58.240856 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Going to try to terminate instance {{(pid=119357) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:14:58.579674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-d9ade7f3-e120-4153-b094-a1af209c6aba tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 204 len: 0 microversion: 2.1 time: 0.383939 Oct 21 15:14:58.580271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 558/1149] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:14:58 2022] DELETE /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:14:58.589316 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:58.590015 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:58.596334 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:58.599156 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:58.602658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:58.602658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:58.602658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:58.602658 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:58.736031 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:58.745829 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-53491b73-aa10-4f37-a2e7-d4691eab8127 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1578 microversion: 2.1 time: 0.160971 Oct 21 15:14:58.746416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 592/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:58 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:14:59.769827 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:14:59.770521 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:14:59.776881 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:59.777360 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:59.777792 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:59.778474 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:14:59.778948 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:14:59.779373 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:14:59.916395 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:14:59.924100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-087f8d8c-9f7c-4ea9-986c-bdfe6c641c48 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1578 microversion: 2.1 time: 0.158625 Oct 21 15:14:59.924919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 559/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:14:59 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:00.948211 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:00.948828 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:00.951281 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:00.956970 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:00.957476 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:00.964223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:00.964223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:00.964223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:00.964223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:01.093931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:15:01.102979 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-6a51e494-0382-4959-811b-cb6f8d486125 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1578 microversion: 2.1 time: 0.158607 Oct 21 15:15:01.103595 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 593/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:00 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:02.010740 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e771a4b5-b5e4-4515-b6af-cf0a011cf96c", "name": "network-vif-deleted", "tag": "43c1dcac-2dbe-49cd-af7e-a725c9841d55"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:15:02.016552 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:02.022791 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:02.023286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:02.023757 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:02.028543 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:02.039083 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] Creating event network-vif-deleted:43c1dcac-2dbe-49cd-af7e-a725c9841d55 for instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c on hv-cinder-83608 Oct 21 15:15:02.044155 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-1b1bc908-5d6b-4547-a901-73870bd7e6ba req-7e863f74-4d57-4c76-98d8-0bdc7884ee3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037167 Oct 21 15:15:02.044942 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 560/1153] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:15:02.126610 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:02.127237 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:02.134564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:02.135074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:02.135505 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:02.136273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:02.136792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:02.137216 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:02.203763 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71ffc3d05d4470fa533cfd6f22184b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb0443c72743c8b3ab016fdf5c9745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:15:02.212265 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1d38206a-05e0-4d10-8f9e-43024f7bf060 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 200 len: 1225 microversion: 2.1 time: 0.090035 Oct 21 15:15:02.212874 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 594/1154] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:02 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:03.234848 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:03.235628 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: e771a4b5-b5e4-4515-b6af-cf0a011cf96c] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:03.244167 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.247890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.247890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.247890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.247890 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.248312 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.260340 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] HTTP exception thrown: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Request method failure captured: Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c HTTP/1.1 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrWKk2Inf_8nsXfevXIfo44kysYCUXmWiC--HQ6MZMLCXk0ASqPkAI-flS5unJRrGyuOjwFxIbruzqHusZCdT0LdNwsNlxyLgB_5v0ROqjVGc_3SY-E7bXK6rYzI96r06_Tob4CVbgjbAxeLCumZyKlMHyfbpQhRvLneSr5Otvdrvk8 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:15:03.262088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57eb0443c72743c8b3ab016fdf5c9745", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: f71ffc3d05d4470fa533cfd6f22184b2 Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. Oct 21 15:15:03.263887 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'e771a4b5-b5e4-4515-b6af-cf0a011cf96c'} Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:15:03.264841 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. Oct 21 15:15:03.266338 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.267737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Returning 404 to user: Instance e771a4b5-b5e4-4515-b6af-cf0a011cf96c could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:15:03.267737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-017d9ad6-85d8-4230-86b2-c85def58c4f2 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c" status: 404 len: 111 microversion: 2.1 time: 0.033265 Oct 21 15:15:03.267737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 561/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:03 2022] GET /compute/v2.1/servers/e771a4b5-b5e4-4515-b6af-cf0a011cf96c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:15:03.781719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:03.782230 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:03.788878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.789362 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.789801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.790499 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.790993 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.791420 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.793919 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:03.805392 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.wsgi [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] HTTP exception thrown: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Request method failure captured: Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: request: DELETE /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f HTTP/1.1 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept: application/json Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Accept-Encoding: identity Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Connection: close Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Length: 0 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Content-Type: application/json Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Host: 10.222.0.60 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Openstack-System-Scope: None Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: User-Agent: python-urllib3/1.26.12 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Auth-Token: gAAAAABjUrWKk2Inf_8nsXfevXIfo44kysYCUXmWiC--HQ6MZMLCXk0ASqPkAI-flS5unJRrGyuOjwFxIbruzqHusZCdT0LdNwsNlxyLgB_5v0ROqjVGc_3SY-E7bXK6rYzI96r06_Tob4CVbgjbAxeLCumZyKlMHyfbpQhRvLneSr5Otvdrvk8 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Id: None Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Domain-Name: None Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Identity-Status: Confirmed Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Is-Admin-Project: True Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Id: default Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Domain-Name: Default Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Project-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Role: reader,member Oct 21 15:15:03.807065 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Roles: reader,member Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57eb0443c72743c8b3ab016fdf5c9745", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-Tenant-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Id: default Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Domain-Name: Default Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Id: f71ffc3d05d4470fa533cfd6f22184b2 Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: X-User-Name: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: method: > Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: exception: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.813149 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: action_args: {'id': 'ac5259dd-4225-4de2-9782-ef2b6373a42f'} Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:15:03.813915 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.815325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.816583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Returning 404 to user: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. {{(pid=119358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:15:03.816583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-921b9db8-821e-49dc-94a3-8ac37aad1bdc tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 404 len: 111 microversion: 2.1 time: 0.030645 Oct 21 15:15:03.816583 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 595/1156] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:15:03 2022] DELETE /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:15:03.819400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:03.820019 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] [instance: ac5259dd-4225-4de2-9782-ef2b6373a42f] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:03.827480 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.827997 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.828516 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.829176 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:03.832772 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:03.832772 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:03.844175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] HTTP exception thrown: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Request method failure captured: Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f HTTP/1.1 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrWKk2Inf_8nsXfevXIfo44kysYCUXmWiC--HQ6MZMLCXk0ASqPkAI-flS5unJRrGyuOjwFxIbruzqHusZCdT0LdNwsNlxyLgB_5v0ROqjVGc_3SY-E7bXK6rYzI96r06_Tob4CVbgjbAxeLCumZyKlMHyfbpQhRvLneSr5Otvdrvk8 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:15:03.845742 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57eb0443c72743c8b3ab016fdf5c9745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57eb0443c72743c8b3ab016fdf5c9745", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 57eb0443c72743c8b3ab016fdf5c9745 Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-TestVolumeBootPattern-125156430 Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: f71ffc3d05d4470fa533cfd6f22184b2 Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-TestVolumeBootPattern-125156430-project Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.847408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': 'ac5259dd-4225-4de2-9782-ef2b6373a42f'} Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:15:03.848380 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. Oct 21 15:15:03.849962 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:03.851387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Returning 404 to user: Instance ac5259dd-4225-4de2-9782-ef2b6373a42f could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:15:03.851387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-c91006b0-2819-4fbc-81db-438dfa0b0478 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f" status: 404 len: 111 microversion: 2.1 time: 0.032224 Oct 21 15:15:03.851387 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 562/1157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:03 2022] GET /compute/v2.1/servers/ac5259dd-4225-4de2-9782-ef2b6373a42f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:15:04.272223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:04.272742 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:04.279474 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:04.279963 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:04.280405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:04.281108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:04.281569 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:04.281995 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:04.362464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lazy-loading 'services' on Instance uuid 36bef36e-e878-4904-8240-bf56058caa55 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:15:04.582913 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-340428d5-fbfd-4ec1-9840-48408858d8c2 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55/os-volume_attachments/3013dc65-43fb-421d-aac0-94869b8af169" status: 202 len: 0 microversion: 2.1 time: 0.314726 Oct 21 15:15:04.583508 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 596/1158] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Oct 21 15:15:04 2022] DELETE /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55/os-volume_attachments/3013dc65-43fb-421d-aac0-94869b8af169 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:15:05.431842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-04461626-0261-43c9-9478-e19f659866e5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] Calling method '.version_select at 0x7fd1e466ac10>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:05.523789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-04461626-0261-43c9-9478-e19f659866e5 tempest-TestVolumeBootPattern-125156430 tempest-TestVolumeBootPattern-125156430-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1403498007" status: 202 len: 0 microversion: 2.1 time: 0.097099 Oct 21 15:15:05.524444 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 563/1159] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Oct 21 15:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1403498007 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:15:05.707751 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:05.708404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:05.714965 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:05.715676 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:05.716124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:05.716836 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:05.717300 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:05.717758 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:05.744455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:15:06.049121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e10370fa-9ede-414a-bda6-a5662d97bca3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 204 len: 0 microversion: 2.1 time: 0.346395 Oct 21 15:15:06.050374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 597/1160] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:15:05 2022] DELETE /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:15:06.059674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:06.060264 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:06.067210 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:06.067893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:06.068346 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:06.069057 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:06.069520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:06.069955 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:06.205149 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:15:06.213594 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a8b08ef3-af68-47da-ac1e-9764c1f83f99 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1512 microversion: 2.1 time: 0.158161 Oct 21 15:15:06.214370 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 564/1161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:06 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:07.238163 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:07.240277 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:07.246931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:07.247486 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:07.248138 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:07.249057 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:07.250328 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:07.250861 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:07.541311 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:15:07.554955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f97d7db4-96d8-4d6c-a3b6-b94d79ed0444 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1512 microversion: 2.1 time: 0.320952 Oct 21 15:15:07.556246 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 598/1162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:07 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:08.389030 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bef36e-e878-4904-8240-bf56058caa55", "name": "network-vif-deleted", "tag": "6c3bdb24-d3da-4d89-9e94-76797c9519c1"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:15:08.400224 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:08.400707 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:08.401467 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:08.414551 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] Creating event network-vif-deleted:6c3bdb24-d3da-4d89-9e94-76797c9519c1 for instance 36bef36e-e878-4904-8240-bf56058caa55 on hv-cinder-83608 Oct 21 15:15:08.420092 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-b6a84a01-76bd-4c1d-90ce-5fab1aa34733 req-643194ab-7cde-45c2-bc1e-f94a3cc79ba4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Oct 21 15:15:08.420692 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 565/1163] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:15:08.581245 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:08.581860 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:08.588514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:08.588999 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:08.589439 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:08.590139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:08.590600 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:08.591060 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:08.675014 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d10cbd26b04ab88cdbd9ca4bb4b901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01624214b124e12a495c748e39dda48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:15:08.683925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-675f1474-416d-4ec4-a9b3-3e48d13499b3 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 200 len: 1303 microversion: 2.1 time: 0.106559 Oct 21 15:15:08.684870 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 599/1164] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:08 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:15:09.710919 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:15:09.711582 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] [instance: 36bef36e-e878-4904-8240-bf56058caa55] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:15:09.719006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:09.719400 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:09.720040 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:09.720923 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:15:09.721445 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:15:09.721839 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:15:09.736088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] HTTP exception thrown: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Request method failure captured: Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 HTTP/1.1 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUrcMM1zGt79ModLoRxYu1zr3yfO8MCkPCHGoHOjTFzQDNes4IJ6kSJ0heUkzDAZ-NuJZxLUye32dqaxQQOYuaWwTitxf1Oo6TlSbhlfqsHCa279K2w84RROnMtzCGamPLDHh2VN1qV9oJ0KDrUgq079jhiOQCg2kfeBosB4Gavv65k0 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: e01624214b124e12a495c748e39dda48 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:15:09.737949 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e01624214b124e12a495c748e39dda48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e01624214b124e12a495c748e39dda48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e01624214b124e12a495c748e39dda48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e01624214b124e12a495c748e39dda48", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: e01624214b124e12a495c748e39dda48 Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-44976353 Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-VolumesSnapshotTestJSON-44976353-project Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: a2d10cbd26b04ab88cdbd9ca4bb4b901 Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-VolumesSnapshotTestJSON-44976353-project Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. Oct 21 15:15:09.740006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '36bef36e-e878-4904-8240-bf56058caa55'} Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:15:09.740832 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. Oct 21 15:15:09.742056 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:15:09.743215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] Returning 404 to user: Instance 36bef36e-e878-4904-8240-bf56058caa55 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:15:09.743215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9dd1c09c-adf9-40fb-b178-f45a997b83a7 tempest-VolumesSnapshotTestJSON-44976353 tempest-VolumesSnapshotTestJSON-44976353-project] 10.222.0.60 "GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55" status: 404 len: 111 microversion: 2.1 time: 0.033902 Oct 21 15:15:09.743215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 566/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:15:09 2022] GET /compute/v2.1/servers/36bef36e-e878-4904-8240-bf56058caa55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:15:48.502781 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:48.503542 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:15:48.661210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-fe22b800-c13a-4d68-9697-b0fb6be1d810 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Action: 'create', calling method: .version_select at 0x7fd1e0f07c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-677059366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDepbYK0TTxBfjXLmnAXvhXTIwDMsC8CIZ6xPZZl6M+KDq5kiib+YsJDUMpxIJIQzkUvZP5pNKRox9v1lSK2r3sx33AJEYc6WUPgObPQmkglKHQedrY2L0fGJsqkEk7b+w=="}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:15:48.678337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-fe22b800-c13a-4d68-9697-b0fb6be1d810 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Getting quotas for project 791930b581eb4c55bebd1e6eacc6b4c0. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:15:48.682419 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.quota [None req-fe22b800-c13a-4d68-9697-b0fb6be1d810 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Getting quotas for user 2eee332e02954cf0a0478a4b98b65f86 and project 791930b581eb4c55bebd1e6eacc6b4c0. Resources: {'key_pairs'} {{(pid=119358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:15:48.763956 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-fe22b800-c13a-4d68-9697-b0fb6be1d810 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.266302 Oct 21 15:15:48.764559 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 600/1166] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Oct 21 15:15:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:16:06.589220 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1445834765", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-677059366", "security_groups": [{"name": "tempest-secgroup-smoke-415731795"}], "networks": [{"uuid": "837293f8-a356-4517-b08d-a12f8f53a88e"}], "block_device_mapping_v2": [{"uuid": "dde4299c-bcba-4789-8b51-a575f17b7e26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:16:06.599334 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:06.600095 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=15 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:06.708660 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.network.neutron [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] validate_networks() for [('837293f8-a356-4517-b08d-a12f8f53a88e', None, None, None, None, None)] {{(pid=119357) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 21 15:16:07.156127 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Flavor limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 21 15:16:07.156586 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Image limits 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 21 15:16:07.157088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Flavor pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 21 15:16:07.157525 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Image pref 0:0:0 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 21 15:16:07.157937 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.virt.hardware [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 21 15:16:07.167139 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:07.167615 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:07.168050 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:07.168776 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:07.169229 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:07.169653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:07.186789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Getting quotas for project 791930b581eb4c55bebd1e6eacc6b4c0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 21 15:16:07.191382 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.quota [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Getting quotas for user 2eee332e02954cf0a0478a4b98b65f86 and project 791930b581eb4c55bebd1e6eacc6b4c0. Resources: {'instances', 'ram', 'cores'} {{(pid=119357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 21 15:16:07.248071 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Going to run 1 instances... {{(pid=119357) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 21 15:16:07.252361 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dde4299c-bcba-4789-8b51-a575f17b7e26',volume_size=None,volume_type=None)] {{(pid=119357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 21 15:16:07.616186 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-efec1358-814f-4c5e-8de7-fdd1fcaa2d00 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.030891 Oct 21 15:16:07.616834 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 567/1167] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Oct 21 15:16:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 21 15:16:07.625489 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=4 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:07.626231 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:07.630324 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-1aa91492-e254-457a-aae9-00adb5854941 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:07.631047 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-1aa91492-e254-457a-aae9-00adb5854941 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:07.685471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-1aa91492-e254-457a-aae9-00adb5854941 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:07.694184 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-1aa91492-e254-457a-aae9-00adb5854941 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1088 microversion: 2.1 time: 0.070044 Oct 21 15:16:07.694772 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 601/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:07 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:08.717880 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8e07f6c1-9e5b-44f6-bba1-0f8491764657 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:08.718454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8e07f6c1-9e5b-44f6-bba1-0f8491764657 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:08.770388 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8e07f6c1-9e5b-44f6-bba1-0f8491764657 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:08.777332 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8e07f6c1-9e5b-44f6-bba1-0f8491764657 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1088 microversion: 2.1 time: 0.063907 Oct 21 15:16:08.777893 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 568/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:08 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:09.800705 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:09.801273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:09.809414 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:09.809930 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:09.810349 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:09.811075 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:09.811535 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:09.811962 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:09.871576 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:09.879833 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5472b47e-40ba-49aa-93f6-b5ebcc19101c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1186 microversion: 2.1 time: 0.083436 Oct 21 15:16:09.880408 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 602/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:09 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:10.906547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:10.906547 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:10.914146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:10.914681 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:10.915096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:10.915984 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:10.916933 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:10.917394 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:11.059842 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:11.068343 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-a353e4f5-deae-4256-a5ac-530215ba115b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1271 microversion: 2.1 time: 0.168439 Oct 21 15:16:11.070863 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 569/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:10 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:11.624372 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:16:11.634975 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:11.635452 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:11.635882 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:11.647082 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.compute.server_external_events [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] Creating event network-changed:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:16:11.652656 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [req-0c070543-e7a0-4686-b52b-3b9c4a6cd35e req-d5a8ffa2-9b3a-4e20-ac06-c31e23210e9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Oct 21 15:16:11.653325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 603/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:16:12.090492 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:12.091248 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:12.097995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:12.098562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:12.099029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:12.099730 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:12.100188 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:12.100618 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:12.234280 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:12.242992 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-dafc9d97-2f0f-48a8-bd3c-4368e3aded08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.156399 Oct 21 15:16:12.243562 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 570/1173] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:12 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:13.266854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:13.267475 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:13.270497 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 21 15:16:13.270699 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: Fri Oct 21 15:16:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 (ip 10.222.0.60) !!! Oct 21 15:16:13.277980 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:13.278471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:13.278936 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:13.279637 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:13.280096 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:13.280525 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:13.412944 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:13.420694 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8ae41507-aba0-4e17-b216-7a31c62f4e69 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.158140 Oct 21 15:16:13.421256 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 604/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:13 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:14.443898 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:14.444511 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:14.450872 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:14.451374 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:14.451789 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:14.452477 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:14.452928 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:14.453349 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:14.580853 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:14.590375 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7d11bb06-5fd9-4cb9-b8d4-13b5dbb49002 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.150495 Oct 21 15:16:14.590988 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 571/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:14 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:16:15.614025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:15.614655 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:15.621106 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:15.621591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:15.622025 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:15.622749 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:15.623204 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:15.623621 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:15.750306 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:15.757983 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-79160345-dc2b-4ad1-94e4-d5601da0f4c4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.148492 Oct 21 15:16:15.758540 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 605/1176] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:15 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:16.781271 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:16.781951 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:16.788763 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:16.789245 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:16.789685 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:16.790376 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:16.790855 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:16.791284 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:16.922502 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:16.930503 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-52048925-f73f-43e6-b8ad-d26f8062e50f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.153155 Oct 21 15:16:16.931132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 572/1177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:16 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:17.954014 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:17.954640 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:17.957670 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell0:SELECT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:17.962468 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:17.966202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:17.966202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:17.966202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:17.966202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:17.966662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:18.095010 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:18.102854 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-04019570-47a4-401d-9feb-a66ffccc026b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.152637 Oct 21 15:16:18.103417 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 606/1178] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:17 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:19.125325 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:19.125901 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:19.127788 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=2 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:19.128970 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell0:SELECT=8 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:16:19.133677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:19.138297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:19.138297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:19.138297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:19.138297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:19.138744 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:19.267412 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:19.275047 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-12393ec8-4e3f-43df-b4d1-25a33ff3d5cc tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.153631 Oct 21 15:16:19.275609 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 573/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:19 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:20.298252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:20.298834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:20.305639 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:20.306124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:20.306564 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:20.307283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:20.307745 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:20.308173 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:20.435588 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:20.443273 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-e2ba9608-8f1a-414d-9c09-05b9a448e45f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.148973 Oct 21 15:16:20.443844 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 607/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:20 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:16:21.466478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:21.467123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:21.474595 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:21.475119 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:21.475549 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:21.476263 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:21.476724 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:21.477151 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:21.610811 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:21.619023 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-80b97581-ced5-4cbc-85bb-e49cf01cbc7c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.156810 Oct 21 15:16:21.619584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 574/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:21 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:22.641793 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:22.642401 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:22.649812 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:22.650297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:22.650759 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:22.651455 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:22.651908 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:22.652330 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:22.783957 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:22.791585 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-07742ebb-1f3a-4b6f-9272-ca1872901c3c tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.153807 Oct 21 15:16:22.792153 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 608/1182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:22 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:23.115198 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "name": "network-vif-plugged", "status": "completed", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:16:23.125578 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:23.126052 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:23.126478 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:23.137745 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] Creating event network-vif-plugged:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:16:23.143096 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-95cc6a3b-38f8-49d6-9427-4be3c3e7f55e req-6d62a4a8-5e6e-4efe-9e6d-8254a9430591 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091519 Oct 21 15:16:23.144314 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 575/1183] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:16:23.814180 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:23.814938 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:23.822158 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:23.822662 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:23.823107 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:23.823802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:23.824255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:23.824708 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:23.953937 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:23.963747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-0badaf45-5a7f-42cc-9011-dc9efaab77ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1259 microversion: 2.1 time: 0.153477 Oct 21 15:16:23.964527 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 609/1184] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:23 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:24.986067 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:24.989404 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:24.993631 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:24.994109 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:24.994545 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:24.995405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:24.995862 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:24.996293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:25.132869 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:25.140674 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7d21f328-7100-48d9-ad32-4b8d3939eb35 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1443 microversion: 2.1 time: 0.158825 Oct 21 15:16:25.141241 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 576/1185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:24 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:25.163186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:16:25.163810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:16:25.170118 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:25.170594 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:25.171061 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:25.171750 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:25.172198 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:25.172618 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:25.305386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:16:25.313037 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-30eb5def-30f3-48c7-ab3c-ddf2f52b7c24 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1443 microversion: 2.1 time: 0.154345 Oct 21 15:16:25.313580 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 610/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:16:25 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:16:27.573256 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:16:27.582623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:16:27.583135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:16:27.583600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:16:27.594507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] Creating event network-changed:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:16:27.600350 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-dd156404-a4b0-4a60-91ae-3b872220c3a4 req-f56394ce-a00a-4b2e-9ce0-c9a297e26388 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085665 Oct 21 15:16:27.600715 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 577/1187] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:18:22.533090 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0f88e93-c9e6-4203-9574-d904772ce35a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 21 15:18:22.533720 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=22 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:18:22.534381 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=50 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:18:22.536133 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 21 15:18:22.543040 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:18:22.543567 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:22.549644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:22.550128 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:22.550562 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:22.551275 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:22.551728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:22.552191 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:22.575236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.objects.instance [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lazy-loading 'flavor' on Instance uuid 8f9fda3f-c444-421a-8593-9d053a0e1d47 {{(pid=119358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 21 15:18:22.839571 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-d376228f-0af0-49c6-adf5-236bc78b207b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "POST /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47/action" status: 202 len: 0 microversion: 2.1 time: 0.308282 Oct 21 15:18:22.840069 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 611/1188] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:18:22 2022] POST /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 21 15:18:22.847859 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f9d17fb-2032-44b2-bd5c-a0f7db6c5003] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 21 15:18:22.848454 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:18:22.849199 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=48 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:18:22.850074 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 21 15:18:22.850242 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Fri Oct 21 15:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 (ip 10.222.0.60) !!! Oct 21 15:18:22.851393 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 21 15:18:22.851519 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Fri Oct 21 15:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 (ip 10.222.0.60) !!! Oct 21 15:18:22.860132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:22.860829 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:22.871337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:22.875177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:22.875177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:22.875177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:22.875177 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:22.875600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:23.006784 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:23.014846 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-7450ff43-acaf-4357-a80e-c8539627757b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.170143 Oct 21 15:18:23.015407 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 578/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:22 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:24.039549 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:24.040251 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:24.048479 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:24.048961 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:24.049398 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:24.050091 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:24.050546 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:24.051008 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:24.056673 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0f88e93-c9e6-4203-9574-d904772ce35a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40072. Oct 21 15:18:24.188725 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:24.196443 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-aad625f2-44f1-467e-8089-244221b24e42 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.162037 Oct 21 15:18:24.197006 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 612/1190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:24 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:25.219475 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:25.220073 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:25.230405 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:25.230860 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:25.231293 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:25.231982 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:25.232428 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:25.232845 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:25.239426 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f9d17fb-2032-44b2-bd5c-a0f7db6c5003] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40076. Oct 21 15:18:25.365046 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:25.373646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-30d99ee5-3c47-4ac4-9b2a-ac5e402875de tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.158069 Oct 21 15:18:25.374202 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 579/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:25 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:26.398185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:26.398728 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:26.406195 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:26.406691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:26.407121 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:26.407798 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:26.408241 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:26.408657 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:26.540111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:26.547842 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-4f50ce38-306d-4493-aa3f-bd5e94d7db43 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.153653 Oct 21 15:18:26.548405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 613/1192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:26 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:27.570688 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:27.571299 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:27.578106 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:27.578585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:27.579049 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:27.579739 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:27.580227 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:27.580653 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:27.707371 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:27.715098 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-f159143b-2340-4653-ac80-4e36649a237a tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.148249 Oct 21 15:18:27.715651 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 580/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:27 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:28.739360 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:28.739998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:28.747166 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:28.747644 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:28.748074 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:28.748759 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:28.749212 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:28.749630 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:28.882865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:28.891519 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-a67ea72f-33c8-4565-bd63-1fb881d28b17 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.156021 Oct 21 15:18:28.892092 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 614/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:28 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:29.914619 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:29.915249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:29.921584 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:29.922058 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:29.922487 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:29.923193 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:29.923646 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:29.924065 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:30.055737 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:30.063939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8f555323-4792-4685-a06d-3b8dcc5cf357 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.153139 Oct 21 15:18:30.064507 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 581/1195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:29 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:31.087197 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:31.087809 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:31.094884 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:31.095368 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:31.095801 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:31.096490 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:31.096943 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:31.097364 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:31.224648 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:31.233223 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-8d84f8df-ecf0-44a4-8927-6f5de04207f8 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.149816 Oct 21 15:18:31.233727 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 615/1196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:31 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:32.256418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:32.257037 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:32.264215 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:32.264703 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:32.265138 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:32.265837 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:32.266297 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:32.266762 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:32.398460 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:32.406939 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-276aa1e6-96a2-41d1-acc0-0564553a2afd tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.154426 Oct 21 15:18:32.407513 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 582/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:32 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:33.429591 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:33.430178 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:33.437404 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:33.437880 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:33.438309 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:33.439259 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:33.439464 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:33.439887 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:33.568789 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:33.577867 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-99b47ab9-6f00-4f23-9fcb-6f25a9e6df78 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.152346 Oct 21 15:18:33.578440 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 616/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:33 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:34.602100 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:34.602731 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:34.609569 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:34.610044 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:34.610471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:34.611209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:34.611657 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:34.612080 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:34.753600 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:34.762583 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8913bb2a-da79-44cd-a773-439702639a95 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.164775 Oct 21 15:18:34.763175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 583/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:34 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:35.785856 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:35.786495 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:35.794228 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:35.794802 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:35.795236 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:35.795931 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:35.796386 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:35.796810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:35.929795 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:35.937593 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-b8104360-baf0-4928-839a-8f5d64ad2d4f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.155703 Oct 21 15:18:35.938202 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 617/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:35 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:36.961511 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:36.962255 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:36.969304 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:36.969798 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:36.970237 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:36.970980 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:36.971436 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:36.971864 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:37.108252 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:37.115969 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-acb8f226-b4d1-44de-afb3-cb7c6d8bd6a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1509 microversion: 2.1 time: 0.158442 Oct 21 15:18:37.116522 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 584/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:36 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:37.138890 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:18:37.140080 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:37.146412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:37.146925 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:37.147352 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:37.148039 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:37.148487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:37.148905 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:37.233418 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119358) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 21 15:18:37.477605 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-2fc37990-acf0-4579-a8f1-f2e0dd88b2ae tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "POST /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47/action" status: 202 len: 0 microversion: 2.1 time: 0.342641 Oct 21 15:18:37.478297 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 618/1202] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Oct 21 15:18:37 2022] POST /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 21 15:18:37.487117 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:37.487727 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:37.493756 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:37.498556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:37.498556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:37.498556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:37.498556 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:37.499038 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:37.635999 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:37.644013 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-342fc7b7-d115-4a2a-9c0f-d1fac8efab5f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1517 microversion: 2.1 time: 0.160794 Oct 21 15:18:37.644585 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 585/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:37 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:38.669189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:38.669792 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:38.675779 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:38.676255 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:38.676684 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:38.677374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:38.678088 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:38.678494 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:38.809435 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:38.817247 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-699eb3a2-68fe-45c4-bcdc-975e9f010d6e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1519 microversion: 2.1 time: 0.152978 Oct 21 15:18:38.817810 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 619/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:38 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:39.503286 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "name": "network-vif-unplugged", "status": "completed", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:18:39.514517 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:39.515064 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:39.515490 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:39.528874 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.compute.server_external_events [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] Unable to find a host for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47. Dropping event network-vif-unplugged {{(pid=119357) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 21 15:18:39.532339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-10ef403a-0294-4853-9142-0caba7d09148 req-da2e115e-e0c8-4f71-8b6c-5950715d69d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030358 Oct 21 15:18:39.532339 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 586/1205] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 21 15:18:39.844949 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:39.845554 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:39.851941 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:39.852413 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:39.852840 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:39.853514 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:39.853958 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:39.854374 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:39.996233 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:40.004018 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-26e53bbb-23f9-407e-8f8d-76baec0de5a7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.162932 Oct 21 15:18:40.004592 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 620/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:39 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:41.028249 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:41.028868 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:41.035341 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:41.035823 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:41.036262 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:41.036953 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:41.037413 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:41.037840 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:41.165122 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:41.172858 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-1ec4074f-82e5-49bc-84e3-615c18912669 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.149217 Oct 21 15:18:41.173417 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 587/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:41 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:42.196033 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:42.196643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:42.203214 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:42.203697 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:42.204131 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:42.204818 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:42.205274 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:42.205696 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:42.337073 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:42.345382 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-f63121ae-662a-4063-bfdb-1bf6f7511a10 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.153306 Oct 21 15:18:42.345960 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 621/1208] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:42 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:43.368884 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:43.369411 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:43.376602 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:43.377080 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:43.377514 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:43.378209 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:43.378677 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:43.379103 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:43.508175 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:43.515996 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-fb5321e1-95c5-459a-8a76-fa8f4cfa6991 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.151278 Oct 21 15:18:43.516554 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 588/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:43 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:44.538908 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:44.539502 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:44.546235 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:44.546767 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:44.547210 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:44.547933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:44.548394 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:44.548834 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:44.685740 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:44.693731 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-71b25217-15d4-4881-9a9d-d2280a00ebe4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.158726 Oct 21 15:18:44.694325 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 622/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:44 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:45.718377 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:45.719018 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:45.725488 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:45.725989 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:45.726416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:45.727132 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:45.727580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:45.727995 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:45.861684 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:45.869738 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-36c6332e-3c23-4407-a4ec-a7c4a9b808a2 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.156369 Oct 21 15:18:45.874296 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 589/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:45 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:46.893923 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:46.894513 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:46.900974 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:46.901447 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:46.901872 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:46.903189 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:46.903637 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:46.904055 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:47.033643 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:47.041393 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-511ccbd7-c8d4-40af-b20f-58df9d295e1b tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.151350 Oct 21 15:18:47.041955 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 623/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:46 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:48.065386 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:48.065990 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:48.072617 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:48.073123 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:48.073539 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:48.074849 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:48.075540 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:48.076146 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:48.216442 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:48.224587 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-4fd8adc5-08ec-40af-936f-83679be4ec12 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.163111 Oct 21 15:18:48.225157 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 590/1213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:48 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:49.249146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:49.249747 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:49.256226 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:49.256698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:49.257124 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:49.257799 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:49.258252 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:49.258691 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:49.278471 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:18:49.388891 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:49.396537 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-bf770414-5a4d-43b2-9a01-b50b9bcd962f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.151597 Oct 21 15:18:49.397108 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 624/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:49 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:49.594623 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "name": "network-vif-plugged", "status": "completed", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:18:49.604213 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:49.604687 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:49.605113 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:49.616409 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] Creating event network-vif-plugged:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:18:49.619916 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR oslo.messaging._drivers.impl_rabbit [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] [0eebeffa-ba46-46a5-b8e1-064ee53e3ada] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 21 15:18:50.420851 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:50.421460 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:50.428242 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:50.428719 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:50.429146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:50.429838 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:50.430283 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:50.430737 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:50.559147 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:50.566849 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-13b528dd-10af-4a62-b282-ee122d2cf34e tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.151029 Oct 21 15:18:50.567416 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 625/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:50 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 21 15:18:50.628189 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO oslo.messaging._drivers.impl_rabbit [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] [0eebeffa-ba46-46a5-b8e1-064ee53e3ada] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40150. Oct 21 15:18:50.631930 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-32c61fff-b9f0-4a46-913a-c2e2256b80a4 req-d577cc68-1b43-419a-bb2a-320093e31e29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.042250 Oct 21 15:18:50.632518 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 591/1216] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:18:51.589698 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:51.590453 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:51.596865 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:51.597343 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:51.597773 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:51.598458 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:51.598935 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:51.599358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:51.734653 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:51.742337 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-5df21799-0d56-4d29-970d-43b5450b0437 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1575 microversion: 2.1 time: 0.156543 Oct 21 15:18:51.742933 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 626/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:51 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:18:52.767704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:18:52.768413 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:18:52.774580 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:52.775088 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:52.775520 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:52.776206 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:18:52.776661 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:18:52.777084 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:18:52.906221 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:18:52.913911 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-9ec2b1d0-1e95-4db5-9a64-fd0eb6ae867f tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1562 microversion: 2.1 time: 0.150958 Oct 21 15:18:52.914471 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 592/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:18:52 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:20:09.661337 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_api:SELECT=30 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:20:09.662135 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG dbcounter [-] [119357] Writing DB stats nova_cell1:SELECT=82 {{(pid=119357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:20:09.665665 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:09.666146 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:20:09.668225 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:20:09.668878 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG dbcounter [-] [119358] Writing DB stats nova_cell1:SELECT=14 {{(pid=119358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 15:20:09.676257 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:20:09.678339 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:09.678879 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:09.679574 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:09.683171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:09.683171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:09.683171 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:09.687313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:09.687806 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:09.688243 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:09.700390 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] Creating event network-changed:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:20:09.706403 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-c3fb6475-85b5-4684-bc90-0032a2df3014 req-29344a3b-465b-4326-80d3-b5622a81c28e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046681 Oct 21 15:20:09.707087 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 593/1219] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:20:09.718461 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Going to try to terminate instance {{(pid=119358) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 21 15:20:10.030293 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-99e58643-2b0b-4352-90d2-5e07cbb339da tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 204 len: 0 microversion: 2.1 time: 0.373902 Oct 21 15:20:10.030934 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 627/1220] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Oct 21 15:20:09 2022] DELETE /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 21 15:20:10.040066 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:10.040800 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:20:10.047495 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:10.047977 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:10.048416 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:10.049204 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:10.049667 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:10.050093 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:10.250029 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.policy [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119357) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:20:10.258548 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-8bc9aba7-6a3c-4e01-a977-39a20e632811 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.222942 Oct 21 15:20:10.261760 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 594/1221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:20:10 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:20:11.282730 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:11.283968 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:20:11.290456 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:11.290981 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:11.291412 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:11.292139 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:11.292584 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:11.293002 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:11.473739 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:20:11.481544 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-ffb06c79-f531-4cfc-8852-9d998aab4789 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1568 microversion: 2.1 time: 0.203903 Oct 21 15:20:11.482111 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 628/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:20:11 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:20:12.127870 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9fda3f-c444-421a-8593-9d053a0e1d47", "name": "network-vif-deleted", "tag": "e6a3ec47-2168-4627-ae9f-8c7d7f376c7b"}]} {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 21 15:20:12.137313 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:12.139655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:12.139655 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:12.149345 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.compute.server_external_events [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] Creating event network-vif-deleted:e6a3ec47-2168-4627-ae9f-8c7d7f376c7b for instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 on hv-cinder-83608 Oct 21 15:20:12.154298 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [req-32228692-de2c-4639-b9ac-0599dd3a7000 req-0eb7610d-3329-4d2e-9c75-a77da039438d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085189 Oct 21 15:20:12.154952 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 595/1223] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Oct 21 15:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 21 15:20:12.505358 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:12.505998 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.compute.api [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119358) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:20:12.512491 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:12.513044 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:12.513487 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:12.514186 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:12.514664 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:12.515095 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG oslo_concurrency.lockutils [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:12.577590 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.policy [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eee332e02954cf0a0478a4b98b65f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791930b581eb4c55bebd1e6eacc6b4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119358) authorize /opt/stack/nova/nova/policy.py:199}} Oct 21 15:20:12.585895 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-23f7a2b0-0dcd-43ba-b4f3-e5b3e16fa1d4 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 200 len: 1219 microversion: 2.1 time: 0.085152 Oct 21 15:20:12.586405 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 629/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:20:12 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 21 15:20:13.609464 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '>' {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:13.610080 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.compute.api [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] [instance: 8f9fda3f-c444-421a-8593-9d053a0e1d47] Fetching instance by UUID {{(pid=119357) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 21 15:20:13.617102 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:13.617577 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:13.618006 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:13.618712 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Acquiring lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 21 15:20:13.619163 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 21 15:20:13.619581 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG oslo_concurrency.lockutils [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Lock "dc1fe804-a1c0-4f42-88c1-97d74249e7fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 21 15:20:13.633326 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.wsgi [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] HTTP exception thrown: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Request method failure captured: Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: request: GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 HTTP/1.1 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept: application/json Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Accept-Encoding: identity Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Connection: close Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Length: 0 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Content-Type: application/json Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Host: 10.222.0.60 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: Openstack-System-Scope: None Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: User-Agent: python-urllib3/1.26.12 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Auth-Token: gAAAAABjUreeA52LBzmadilpd_YsPo8XeKRAFcYdOHShRR5Xnk43PmMw0OsNIDqWA5plNKtAx6r5SXnzZWe5X4_v9GqZfzhCSZH_YpyEQdTVjUYUDwg_Bn3GjqsZ9P-jfImQt6Xjvipwbr3FCUmevnKWxXCgmCsjepmaPdBxcBggiPJqs2h2Z1k Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Id: None Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Domain-Name: None Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Identity-Status: Confirmed Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Is-Admin-Project: True Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Id: default Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Domain-Name: Default Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Id: 791930b581eb4c55bebd1e6eacc6b4c0 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Project-Name: tempest-TestShelveInstance-740080834 Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Role: reader,member Oct 21 15:20:13.636408 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Roles: reader,member Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/791930b581eb4c55bebd1e6eacc6b4c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/791930b581eb4c55bebd1e6eacc6b4c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/791930b581eb4c55bebd1e6eacc6b4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_791930b581eb4c55bebd1e6eacc6b4c0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant: tempest-TestShelveInstance-740080834 Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Id: 791930b581eb4c55bebd1e6eacc6b4c0 Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-Tenant-Name: tempest-TestShelveInstance-740080834 Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User: tempest-TestShelveInstance-740080834-project Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Id: default Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Domain-Name: Default Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Id: 2eee332e02954cf0a0478a4b98b65f86 Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: X-User-Name: tempest-TestShelveInstance-740080834-project Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: method: > Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: exception: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. Oct 21 15:20:13.638295 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: action_args: {'id': '8f9fda3f-c444-421a-8593-9d053a0e1d47'} Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: {{(pid=119357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 21 15:20:13.642418 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. Oct 21 15:20:13.644704 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: ERROR nova.api.openstack.wsgi Oct 21 15:20:13.646200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: DEBUG nova.api.openstack.wsgi [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Returning 404 to user: Instance 8f9fda3f-c444-421a-8593-9d053a0e1d47 could not be found. {{(pid=119357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 21 15:20:13.646200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: INFO nova.api.openstack.requestlog [None req-6aa04be3-c026-4a3f-ba79-2f29654dfc08 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47" status: 404 len: 111 microversion: 2.1 time: 0.033419 Oct 21 15:20:13.646200 dv-cinder-836083-16-iscsi devstack@n-api.service[119357]: [pid: 119357|app: 0|req: 596/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Oct 21 15:20:13 2022] GET /compute/v2.1/servers/8f9fda3f-c444-421a-8593-9d053a0e1d47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 21 15:20:13.846185 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: DEBUG nova.api.openstack.wsgi [None req-63898b2c-0e4a-42be-b4ff-4730c8fdb4e7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] Calling method '.version_select at 0x7fd1e106a4c0>' {{(pid=119358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 21 15:20:13.933315 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: INFO nova.api.openstack.requestlog [None req-63898b2c-0e4a-42be-b4ff-4730c8fdb4e7 tempest-TestShelveInstance-740080834 tempest-TestShelveInstance-740080834-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-677059366" status: 202 len: 0 microversion: 2.1 time: 0.091630 Oct 21 15:20:13.933899 dv-cinder-836083-16-iscsi devstack@n-api.service[119358]: [pid: 119358|app: 0|req: 630/1226] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Oct 21 15:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-677059366 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)